-- Logs begin at Sat 2022-09-03 00:43:59 UTC, end at Sat 2022-09-03 01:53:30 UTC. -- Sep 03 01:23:54.256316 dv-cinder-838009-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 03 01:23:54.265394 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 3 01:23:54 2022] *** Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: nodename: dv-cinder-838009-7-iscsi Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: machine: x86_64 Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: clock source: unix Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: pcre jit disabled Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: detected number of CPU cores: 4 Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: current working directory: / Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: detected binary path: /usr/bin/uwsgi-core Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: your processes number limit is 47680 Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: your memory page size is 4096 bytes Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: detected max file descriptor number: 2048 Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: lock engine: pthread robust mutexes Sep 03 01:23:54.270183 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: thunder lock: enabled Sep 03 01:23:54.271133 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 03 01:23:54.271133 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 03 01:23:54.309798 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: Python main interpreter initialized at 0x5649af4119c0 Sep 03 01:23:54.309798 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: python threads support enabled Sep 03 01:23:54.309798 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: your server socket listen backlog is limited to 100 connections Sep 03 01:23:54.309798 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: your mercy for graceful operations on workers is 90 seconds Sep 03 01:23:54.310155 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 01:23:54.310232 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: *** Operational MODE: preforking *** Sep 03 01:23:54.310517 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: *** uWSGI is running in multiple interpreter mode *** Sep 03 01:23:54.310517 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: spawned uWSGI master process (pid: 105881) Sep 03 01:23:54.310737 dv-cinder-838009-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 03 01:23:54.312752 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: spawned uWSGI worker 1 (pid: 105894, cores: 1) Sep 03 01:23:54.312752 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: spawned uWSGI worker 2 (pid: 105895, cores: 1) Sep 03 01:23:54.312752 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 01:23:54.974940 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 03 01:23:54.976535 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 03 01:23:56.066744 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 01:23:56.066744 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: from cryptography.utils import int_from_bytes Sep 03 01:23:56.067333 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 01:23:56.067333 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: from cryptography.utils import int_from_bytes Sep 03 01:23:56.071787 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 01:23:56.071787 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: from cryptography.utils import int_from_bytes Sep 03 01:23:56.072247 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 01:23:56.072247 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: from cryptography.utils import int_from_bytes Sep 03 01:23:58.572400 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 01:23:58.572979 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 01:23:58.573170 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 01:23:58.573529 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 01:23:58.573790 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 01:23:58.573889 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 01:23:58.574232 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 01:23:58.574314 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.574513 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.574666 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 01:23:58.574833 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.575034 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 01:23:58.575163 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.575297 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 01:23:58.575478 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.575690 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.575778 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.576022 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.576111 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.576347 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.576446 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.576668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.576756 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.576956 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.577050 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.577269 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.577367 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.577589 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-838009-7-iscsi {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.577684 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.577909 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.577997 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.578213 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.578302 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.578521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.578620 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.578841 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.578930 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.579143 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.579237 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-838009-7-iscsi {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.579465 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.579568 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.579768 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.579877 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.580083 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.580259 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.580412 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.580718 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.580879 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.581083 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.581258 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.581375 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.581482 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.581642 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.581852 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.581998 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.582190 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.582322 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.582511 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.582628 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.582827 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.582917 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.583174 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.583263 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.583485 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.583583 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.583797 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.583892 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-838009-7-iscsi {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.584122 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.584342 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.584430 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.584527 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.584751 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.584848 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.585065 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.585162 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.585464 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-838009-7-iscsi {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.585552 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.585769 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.585865 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.586090 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.586225 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.586428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.586541 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.586845 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.586932 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.587162 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.587258 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.587477 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.587579 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.587793 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.587880 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.588113 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.588203 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.588417 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.588519 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.588727 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.588821 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.589036 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.589125 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.589355 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.589444 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.589659 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.589768 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.589967 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.590075 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.590214 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.590313 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.590546 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.590636 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.590868 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.590960 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.591188 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.591279 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.591496 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.591582 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.591746 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.591844 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.591994 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.592092 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.592313 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.592422 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.592629 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.592729 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.592934 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.593023 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.593234 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.593332 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.593488 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.593578 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.593810 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.593899 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.594128 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.594222 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.594457 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.594561 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.594764 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.594855 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.595069 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.595167 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.595376 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.595464 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.595687 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.595774 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.595993 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.596093 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.596299 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.596883 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.597133 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.597305 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.597450 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.597554 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.597754 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.597849 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.598063 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.598151 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.598394 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.598503 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.598722 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.598812 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.599028 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.599126 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.599346 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.599442 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.599664 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.599809 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.599985 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.600120 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.600276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.600375 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.600581 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.600668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.600899 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.600988 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.601227 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.601321 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.601526 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.601625 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.601776 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.601867 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.602076 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.602173 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.602402 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.602533 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.602723 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.602836 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.603025 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.603122 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.603304 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.603400 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.603617 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.603723 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.603918 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.604013 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.604224 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.604337 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.604528 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.604638 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.604831 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.604928 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.605137 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.605232 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.605437 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.605545 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.605744 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.605839 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.606044 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.606150 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.606359 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.606468 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.606676 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.606772 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.606980 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.607077 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.607285 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.607398 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.607592 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.607688 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.607894 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.607988 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.608197 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.608302 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.608501 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.608604 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.608804 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.608907 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.609122 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.609226 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.609426 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.609522 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.609745 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.609921 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.610040 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.610182 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.610364 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.610455 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.610661 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.610749 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.610978 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.611069 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.611284 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.611378 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.611585 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.611672 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.611899 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.612583 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.612748 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.612854 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.613053 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.613146 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.613369 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.613465 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.613675 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.613764 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.613986 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.614080 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.614288 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.614441 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.614616 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.614705 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.614916 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.615019 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.615219 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.615313 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.615520 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.615608 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.615821 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.615918 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.616120 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.616208 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.616435 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.616524 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.616744 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.616840 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.617051 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.617139 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.617351 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.617439 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.617653 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.617748 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.617968 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.618055 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.618287 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.618390 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.618625 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.618722 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.618936 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.619025 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.619246 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.619349 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.619568 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:23:58.619664 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.619909 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.620032 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.620228 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.620339 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.620540 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.620636 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.620853 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.620949 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.621177 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.621282 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.621487 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.621583 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.621799 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.621887 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.622108 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.622206 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.622447 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.622553 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.622767 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.622861 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.623084 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.623180 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.623403 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.623499 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.623715 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.623810 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.624037 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.624134 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.624348 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.624436 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.624667 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.624755 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.624989 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.625084 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.625308 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.625395 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.625618 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.625714 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.625931 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.626029 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.626254 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.626376 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.626610 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.626699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.626934 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.627029 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.627249 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.627337 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.627574 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.627697 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.627993 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.628142 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.628393 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.628483 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.628741 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.628830 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.629061 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.629156 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.629376 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.629466 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.629699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.629787 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.630017 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.630129 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.630356 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.630496 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.630676 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.630779 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.630989 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.631086 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.631304 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.631395 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.631620 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.631717 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.631945 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.632108 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.632264 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.632450 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.632581 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.632769 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.632937 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.633092 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.633229 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.633389 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.633534 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.633682 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.633843 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.634010 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.634155 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.634323 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.634486 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.634661 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.634800 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.634972 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.635110 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.635280 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.635436 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.635581 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.635728 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.635878 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.636043 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.636190 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.636359 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.636496 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.636672 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.636893 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.636982 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.637227 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.637330 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.637535 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.637622 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.637869 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.637957 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.638177 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.638277 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.638523 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.638614 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.638836 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.638924 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.639144 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.639240 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.639451 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.639546 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.639765 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.639860 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.640074 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.640159 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.640377 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.640487 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.640687 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.640793 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.640995 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.641083 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.641302 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.641409 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.641608 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.641695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.641916 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.642004 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.642224 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.642312 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.642562 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.642658 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.642870 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.642971 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.643212 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.643304 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.643522 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.643654 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.643838 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.643931 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.644151 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.644238 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.644462 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.644570 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.644773 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.644861 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.645088 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.645174 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.645417 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.645516 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.645726 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.645913 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.646053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.646190 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.646377 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.646524 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.646696 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.646841 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.647002 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.647141 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.647313 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.647459 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.647606 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.647742 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.647910 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.648056 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.648204 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.648341 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.648509 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.648648 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.648813 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.648952 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.649120 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.649258 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.649410 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.649552 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.649701 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.649851 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.649986 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.650122 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.650353 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.650748 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.650883 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.651031 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.651192 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.651330 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.651498 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.651592 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.651801 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.651899 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.652122 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.652209 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.652433 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.652523 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.652745 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.652842 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.653063 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.653171 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.653397 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.653495 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.653714 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.653819 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.654030 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.654125 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.654374 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.654486 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.654677 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.654774 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.654989 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.655086 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.655300 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.655395 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.655611 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.655708 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.655929 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.656027 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.656237 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.656341 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.656554 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.656651 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.656865 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.656969 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.657187 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.657284 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.657497 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.657594 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.657819 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.657915 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.658122 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.658226 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.658469 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.658567 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.658787 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.659383 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.659626 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.659739 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.659940 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.660037 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.660262 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.660359 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.660609 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.660714 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.660948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.661044 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.661259 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.661356 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.661572 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.661676 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.661883 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.661980 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.662194 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.662290 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.662534 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.662643 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.662844 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.662932 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.663162 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.663270 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.663469 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.663565 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.663790 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.663895 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.664101 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.664197 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.664423 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.664519 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.664726 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.664822 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.665041 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.665140 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.665356 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.665497 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.665677 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.665815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.665985 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.666117 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.666297 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.666477 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.666642 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.666778 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.666954 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.667106 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.667264 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.667400 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.667574 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.667710 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.667890 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.668034 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.668172 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.668316 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.668483 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.668618 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.668796 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.668940 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.669103 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.669246 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.669412 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.669547 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.669714 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.669856 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.670026 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.670168 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.670358 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.670505 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.670660 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.670791 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.670949 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.671080 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.671258 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.671395 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.671571 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.671711 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.671876 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.672020 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.672182 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.672326 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.672498 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.672641 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.672799 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.672940 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.673120 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.673257 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.673421 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.673520 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.673727 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.673815 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.674028 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.674134 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.674360 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.674480 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.674732 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.674831 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.675049 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.675146 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.675357 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.675445 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.675666 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.675765 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.675976 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.676072 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.676323 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.676411 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.676631 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.676756 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.676940 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.677036 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.677248 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.677335 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.677557 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.677652 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.677871 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.677958 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.678179 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.678273 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.678515 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.678604 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.678825 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.678913 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.679136 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.679230 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.679443 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.679531 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.679752 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.679841 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.680063 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.680157 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.680367 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.680454 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.680673 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.680762 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.680979 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.681105 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.681280 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.681380 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.681585 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.681680 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.682173 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.682264 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.682510 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.682763 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.682853 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.683095 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.683191 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.683411 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.683506 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.683728 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.683992 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.684081 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.684327 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.684433 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.684648 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.684745 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.684974 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.685063 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.685303 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.685389 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.685608 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.685704 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.685913 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.686009 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.686216 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.686305 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.686547 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.686641 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.686856 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.687021 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.687160 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.687254 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.687463 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.687551 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.687767 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.687864 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.688076 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.688172 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.688377 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.688465 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.688679 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.688777 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.688980 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.689068 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.689282 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.689370 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.689588 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.689676 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.689890 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.689976 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.690792 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.690889 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.691105 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.691241 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.691431 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.691528 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.691740 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.691870 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.692045 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.692133 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.692349 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.692437 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.692652 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.692752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.692977 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.693070 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.693284 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.693379 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.693592 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.693691 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.693908 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.693996 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.694258 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.694365 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.694593 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.694690 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.694898 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.694993 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.695220 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.695314 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.695524 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.695622 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.695828 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.695916 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.696130 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.696218 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.696436 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.696525 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.696741 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.696839 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.697042 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.697130 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.697349 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.697438 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.697656 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.697744 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.697962 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.698049 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.698267 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.698382 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.698593 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.698692 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.698901 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.698989 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.699203 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.699292 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.699514 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.699602 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.699819 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.699913 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.700119 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.700207 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.700420 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.700507 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.700728 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.700821 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.701035 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.701123 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.701337 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.701424 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.701641 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.701736 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.701940 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.702033 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.702253 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.702368 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.702579 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.702680 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.702881 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.702967 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.703185 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.703270 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.703490 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.703576 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.703794 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.703886 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.704096 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.704184 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.704401 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.704488 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.704714 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.704807 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.705015 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.705112 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.705317 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.705418 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.705657 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.705827 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.705993 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.706090 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.706319 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.706458 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.706632 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.706720 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.706945 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.707049 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.707254 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.707343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.707555 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.707649 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.707864 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.707965 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.708166 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.708255 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.708469 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.708557 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.708771 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.708867 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.709077 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.709166 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.709378 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.709473 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.709681 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.709778 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.709982 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.710071 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.710283 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.710391 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.710612 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.710702 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.710916 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.711003 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.711225 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.711314 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.711524 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.711623 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.711827 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.711916 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.712131 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.712238 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.712450 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.712538 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.712757 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.712845 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.713066 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.713154 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.713374 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.713463 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.713700 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.713831 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.714020 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.714118 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.714354 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.714447 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.714673 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.714761 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.714987 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.715087 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.715291 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.715381 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.715606 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.715693 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.715920 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.716084 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.716231 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.716318 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.716536 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.716626 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.716839 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.716940 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.717153 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.717246 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.717463 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.717558 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.717770 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.717865 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.718080 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.718169 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.718424 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.718527 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.718741 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.718830 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.719044 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.719132 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.719355 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.719448 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.719665 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.719754 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.719972 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.720068 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.720283 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.720371 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.720595 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.720683 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.720903 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.720990 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.721212 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.721832 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.722037 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.722169 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.722394 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.722500 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.722686 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.722788 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.722993 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.723082 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.723303 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.723391 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.723612 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.723713 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.723918 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.724005 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.724225 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.724311 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.724535 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.724630 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.724841 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.724929 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.725151 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.725244 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.725454 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.725554 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.725764 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.725899 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.726069 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.726166 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.726399 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.726515 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.726714 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.726815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.727032 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.727121 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.727344 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.727433 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.727710 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.727796 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.728018 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.728115 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.728333 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.728422 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.728646 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.728733 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.728950 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.729039 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.729275 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.729363 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.729597 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.729685 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.729915 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.730013 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.730227 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.730323 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.730570 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.730658 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.730875 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.730977 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.731184 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.731280 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.731509 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.731597 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.731813 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.731910 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.732119 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.732208 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.732424 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.732521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.732744 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.732842 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.733047 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.733135 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.733365 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.733453 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.733676 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.733764 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.734004 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.734100 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.734314 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.734422 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.734667 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.734792 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.735087 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.735176 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.735405 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.735493 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.735717 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.735806 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.736039 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.736155 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.736366 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.736457 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.736675 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.736773 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.737069 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.737178 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.737378 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.737469 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.737739 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.737827 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.738052 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.738143 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.738396 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.738502 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.738716 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.738814 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.739025 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.739113 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.739349 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.739445 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.739662 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.739767 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.739974 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.740063 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.740282 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.740377 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.740610 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.740709 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.740938 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.741028 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.741256 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.741345 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.741583 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.741682 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.741930 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.742026 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.742239 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.742388 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.742570 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.742662 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.742881 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.742980 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.743189 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.743278 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.743496 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.743601 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.743817 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.743907 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.744125 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.744226 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.744434 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.744528 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.744746 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.744844 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.745053 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.745150 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.745362 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.745452 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.745667 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.745756 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.745988 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.746137 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.746291 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.746439 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.746626 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.746727 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.746935 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.747033 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.747254 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.747342 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.747561 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.747661 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.747871 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.747969 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.748191 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.748279 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.748496 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.748584 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.748801 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.748899 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.749106 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.749202 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.749407 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.749496 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.749735 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.749824 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.750039 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.750127 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.750369 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.750505 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.750675 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.750765 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.751010 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.751099 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.751317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.751411 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.751642 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.751732 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.751966 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.752054 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.752286 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.752383 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.753125 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.753286 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.753443 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.753536 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.753770 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.753869 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.754077 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.754228 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.754404 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.754511 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.754718 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.754821 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.755023 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.755125 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.755334 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.755430 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.755639 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.755737 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.755947 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.756043 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.756252 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.756344 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.756554 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.756645 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.756862 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.756986 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.757181 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.757275 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.757483 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.757575 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.757790 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.757879 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.758098 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.758186 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.758423 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.758531 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.758729 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.758819 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.759032 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.759121 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.759356 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.759446 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.759661 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.759750 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.759967 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.760064 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.760275 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.760364 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.760596 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.760685 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.760914 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.761015 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.761226 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.761322 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.761543 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.761646 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.761853 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.761953 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.762166 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.762256 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.762508 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.762659 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.762809 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.762955 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.763116 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.763254 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.763431 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.763589 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.763743 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.763965 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.764108 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.764243 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.764385 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.764569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.764677 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.764898 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.764994 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.765219 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.765308 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.765532 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.765791 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.765889 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.766128 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.766217 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.766468 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.766566 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.766781 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.766886 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.767092 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.767189 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.767403 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.767502 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.767711 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.767802 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.768024 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.768124 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.768887 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.769053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.769196 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.769284 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.769513 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.769603 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.769837 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.769938 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.770154 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.770243 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.770494 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.770589 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.770827 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.770923 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.771143 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.771238 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.771463 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.771565 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.771769 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.771860 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.772085 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.772174 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.772401 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.772499 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.772714 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.772803 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.773025 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.773114 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.773336 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.773436 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.773649 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.773738 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.773963 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.774051 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.774272 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.774416 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.774614 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.774703 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.774926 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.775021 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.775242 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.775330 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.775811 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.775911 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.776127 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.776222 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.776447 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.776545 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.776788 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.776891 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.777080 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.777200 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.777395 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.777490 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.777726 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.777911 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.778047 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.778229 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.778385 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.778589 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.778713 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.778916 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.779235 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.779340 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.779546 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.779635 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.779864 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.779954 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.780189 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.780289 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.780494 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.780584 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.780800 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.780891 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.781109 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.781200 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.781416 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.781508 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.781721 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.781823 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.782029 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.782120 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.782349 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.782440 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.782661 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.782750 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.782968 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.783064 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.783277 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.783365 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.783591 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.783817 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.783947 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.784270 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.784380 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.784589 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.784698 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.784990 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.785120 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.785327 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.785467 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.785649 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.785784 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.785959 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.786113 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.786285 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.786471 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.786640 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.786776 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.786949 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.787084 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.787269 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.787409 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.787581 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.787720 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.787887 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.788024 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.788192 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.788337 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.788502 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.788653 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.788822 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.788959 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.789128 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.789272 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.789437 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.789596 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.789731 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.789865 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.790054 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.790191 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.790371 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.790478 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.790683 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.790772 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.790985 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.791079 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.791296 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.791395 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.791598 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.791694 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.791903 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.792000 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.792204 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.792294 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.792506 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.792596 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.792809 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.792897 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.793109 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.793198 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.793413 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.793501 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.793714 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.793801 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.794021 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.794111 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.794347 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.794449 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.794670 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.794768 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.794979 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.795070 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.795307 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.795397 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.795609 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.795708 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.795912 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.796001 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.796226 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.796315 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.796531 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.796673 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.796840 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.796936 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.797147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.797271 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.797463 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.797582 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.797787 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.797907 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.798104 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.798416 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.798513 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.798779 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.798954 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.799099 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.799289 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.800285 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.800396 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.800669 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.800829 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.800997 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.801160 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.801339 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.801442 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.801678 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.801786 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.801988 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.802097 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.802364 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.802564 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.803121 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.803195 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.803269 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.803338 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.803412 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.803480 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.803578 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.803855 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.804012 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.804172 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.804313 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.804450 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.804600 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.804737 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.804871 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.805017 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.805154 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.805314 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.805460 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.805627 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.805765 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.805941 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.806079 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.806252 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.806419 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.806588 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.806732 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.806899 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.806988 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.807209 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.807305 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.807523 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.807630 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.807840 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.807937 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.808152 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.808239 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.808470 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.808567 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.808783 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.808875 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.809093 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.809191 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.809403 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.809493 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.809715 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.809804 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.810028 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.810128 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.810382 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.810477 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.810680 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.810769 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.810988 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.811077 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.811321 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.811645 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.811741 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.811957 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.812045 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.812277 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.812599 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.812690 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.812911 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.813001 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.813234 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.813336 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.813557 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.813647 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.813871 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.813962 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.814192 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.814290 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.814535 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.814637 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.814866 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.814955 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.815328 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.815453 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.815729 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.815817 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.816077 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.816167 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.816406 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.816495 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.816713 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.816843 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.817020 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.817110 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.817331 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.817421 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.817651 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.817757 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.817961 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.818050 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.818265 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.818376 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.818600 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.818689 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.818912 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.819013 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.819218 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.819307 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.819522 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.819650 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.822121 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.822282 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.822484 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.822609 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.822719 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.822836 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.822945 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.823066 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.823184 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.823309 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.823419 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.823526 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.823632 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.823747 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.823855 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.823961 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.824074 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.824181 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.824301 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.824409 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.824498 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.824579 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.824665 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.824752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.824840 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.824921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.825041 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.825129 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.825216 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.825304 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.825393 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.825482 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.825562 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.825642 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.825720 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.825798 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.825890 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.825977 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.826057 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.826136 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.826214 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.826300 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.826401 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.826493 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.826583 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.826664 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.826743 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.826831 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.827001 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.827125 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.827311 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.827452 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.827641 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.827781 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.827950 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.828105 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.828261 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.828424 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.828575 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.828762 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.828884 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.829081 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.829194 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.829398 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.829496 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.829719 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.829809 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.830037 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.830125 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.830384 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.830491 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.831194 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.831311 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.831543 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.831769 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.831954 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.832123 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.832277 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.832401 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.832612 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.832701 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.832939 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.833036 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.833267 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.833356 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.833591 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.833686 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.833910 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.833999 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.834219 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.834314 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.834565 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.834673 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.834882 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.834972 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.835193 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.835282 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.835503 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.835600 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.835819 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.835906 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.836133 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.836228 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.836448 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.836549 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.836766 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.836853 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.837076 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.837166 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.837397 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.837506 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.837719 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.837814 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.838047 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.838143 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.838397 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.838492 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.838713 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.838804 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.839047 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.839157 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.839400 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.839496 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.839719 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.839808 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.840026 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.840121 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.840275 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105895) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 01:23:58.840389 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.840712 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.841030 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.841344 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:23:58.841593 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105894) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 01:23:58.993760 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO dbcounter [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Registered counter for database nova_api Sep 03 01:23:58.995377 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO dbcounter [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] Registered counter for database nova_api Sep 03 01:23:59.015863 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_db.sqlalchemy.engines [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:23:59.017379 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG oslo_db.sqlalchemy.engines [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:23:59.023401 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writer thread running {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:23:59.024341 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writer thread running {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:23:59.080634 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.context [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6a8cb256-d368-4056-95f0-fbb32024e9fd(cell1) {{(pid=105895) load_cells /opt/stack/nova/nova/context.py:464}} Sep 03 01:23:59.081471 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.context [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6a8cb256-d368-4056-95f0-fbb32024e9fd(cell1) {{(pid=105894) load_cells /opt/stack/nova/nova/context.py:464}} Sep 03 01:23:59.085095 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:23:59.085319 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:23:59.085583 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:23:59.085796 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:23:59.087189 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:23:59.087420 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:23:59.087927 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:23:59.088165 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:23:59.088381 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:23:59.088618 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:23:59.090365 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:23:59.090631 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG oslo_concurrency.lockutils [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105894) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:23:59.092340 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO dbcounter [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Registered counter for database nova_cell0 Sep 03 01:23:59.092609 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO dbcounter [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] Registered counter for database nova_cell0 Sep 03 01:23:59.096428 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO dbcounter [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Registered counter for database nova_cell1 Sep 03 01:23:59.097373 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO dbcounter [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] Registered counter for database nova_cell1 Sep 03 01:23:59.104076 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_db.sqlalchemy.engines [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:23:59.106236 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_db.sqlalchemy.engines [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:23:59.107181 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG oslo_db.sqlalchemy.engines [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:23:59.109548 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writer thread running {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:23:59.109780 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG oslo_db.sqlalchemy.engines [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:23:59.114529 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writer thread running {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:23:59.119788 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writer thread running {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:23:59.249611 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writer thread running {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:23:59.258958 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO dbcounter [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Registered counter for database nova_cell0 Sep 03 01:23:59.262021 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO dbcounter [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] Registered counter for database nova_cell0 Sep 03 01:23:59.267835 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_db.sqlalchemy.engines [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105895) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:23:59.270530 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG oslo_db.sqlalchemy.engines [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105894) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:23:59.273285 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writer thread running {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:23:59.275655 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writer thread running {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:23:59.729339 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: WARNING keystonemiddleware.auth_token [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 01:23:59.736604 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: WARNING keystonemiddleware.auth_token [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 01:23:59.767697 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: WARNING keystonemiddleware.auth_token [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 01:23:59.775174 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: WARNING keystonemiddleware.auth_token [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 01:24:00.077687 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: WARNING keystonemiddleware.auth_token [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 01:24:00.083782 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: WARNING keystonemiddleware.auth_token [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 01:24:00.089530 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5649af4119c0 pid: 105895 (default app) Sep 03 01:24:00.091705 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:24:00.092871 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001705 Sep 03 01:24:00.093283 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Sat Sep 3 01:24:00 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:24:00.121198 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: WARNING keystonemiddleware.auth_token [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 01:24:00.127197 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: WARNING keystonemiddleware.auth_token [None req-9198eea6-f37d-4002-b4cb-f5be0a7d8577 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 01:24:00.133054 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5649af4119c0 pid: 105894 (default app) Sep 03 01:25:22.131154 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:22.132481 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001776 Sep 03 01:25:22.133098 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:25:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:25:22.146436 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_api:SELECT=3 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:22.147622 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_cell1:SELECT=3 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:22.148574 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_cell0:SELECT=3 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:22.150725 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:23.021368 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-77ce8b96-1697-4896-b3fd-f5756d7ee66c admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:23.054755 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-77ce8b96-1697-4896-b3fd-f5756d7ee66c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.913395 Sep 03 01:25:23.055656 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1292 bytes} [Sat Sep 3 01:25:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:25:25.420938 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:25.422109 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-8566a45c-cd6a-492a-9127-ceb8a22e4485 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Sep 03 01:25:25.422779 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:25:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:25:25.872800 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-903fc756-035f-4c47-9b8c-9ca01926ccf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "ram": 256, "swap": 0, "id": "c1", "disk": 1, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:25.979989 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-903fc756-035f-4c47-9b8c-9ca01926ccf7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.550951 Sep 03 01:25:25.980682 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1283 bytes} [Sat Sep 3 01:25:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:25:25.999117 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writing DB stats nova_api:SELECT=3 {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:26.001214 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writing DB stats nova_cell1:SELECT=3 {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:26.003414 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writing DB stats nova_cell0:SELECT=3 {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:26.005309 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:26.219444 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-cc6cd286-dd53-4293-a9c0-2222473d1f52 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:26.366090 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-cc6cd286-dd53-4293-a9c0-2222473d1f52 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.373514 Sep 03 01:25:26.366731 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1336 bytes} [Sat Sep 3 01:25:25 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:25:28.772719 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-903fc756-035f-4c47-9b8c-9ca01926ccf7 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:28.773958 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-903fc756-035f-4c47-9b8c-9ca01926ccf7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001685 Sep 03 01:25:28.774499 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:25:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:25:29.531233 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-7a1b37be-54c6-45ee-b21b-bfbc02ba3503 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "os-flavor-access:is_public": true, "id": "d1", "swap": 0}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:29.661202 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-7a1b37be-54c6-45ee-b21b-bfbc02ba3503 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.879859 Sep 03 01:25:29.662045 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1283 bytes} [Sat Sep 3 01:25:28 2022] POST /compute/v2.1/flavors => generated 404 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:25:29.674410 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-29955dd5-c62d-4dfc-9092-51f18df6c077 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:29.789705 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-29955dd5-c62d-4dfc-9092-51f18df6c077 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119592 Sep 03 01:25:29.797095 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1336 bytes} [Sat Sep 3 01:25:29 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:25:32.188041 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-7a1b37be-54c6-45ee-b21b-bfbc02ba3503 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:32.189221 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-7a1b37be-54c6-45ee-b21b-bfbc02ba3503 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002199 Sep 03 01:25:32.189653 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:25:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:25:32.591334 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-20c0d239-9fb7-4a39-be68-31677feac68e admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "name": "ds1G", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:32.664299 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-20c0d239-9fb7-4a39-be68-31677feac68e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.468348 Sep 03 01:25:32.664773 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1283 bytes} [Sat Sep 3 01:25:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 01:25:32.677332 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-7be9abbe-0c5e-49e9-a66b-ec608fd43140 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:32.754474 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-7be9abbe-0c5e-49e9-a66b-ec608fd43140 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080673 Sep 03 01:25:32.755148 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1336 bytes} [Sat Sep 3 01:25:32 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:25:35.201786 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-20c0d239-9fb7-4a39-be68-31677feac68e admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:35.203545 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-20c0d239-9fb7-4a39-be68-31677feac68e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002184 Sep 03 01:25:35.203951 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:25:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:25:35.623037 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-887ee4ae-544d-43a9-bdef-532504b92a6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "ram": 2048}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:35.692255 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-887ee4ae-544d-43a9-bdef-532504b92a6c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.482126 Sep 03 01:25:35.693214 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1283 bytes} [Sat Sep 3 01:25:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:25:35.706386 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-2f1066c8-8d74-4dfe-bafb-a25c2d1d8328 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:35.783320 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-2f1066c8-8d74-4dfe-bafb-a25c2d1d8328 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081354 Sep 03 01:25:35.783908 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1336 bytes} [Sat Sep 3 01:25:35 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:25:38.165738 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-887ee4ae-544d-43a9-bdef-532504b92a6c admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:38.167402 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-887ee4ae-544d-43a9-bdef-532504b92a6c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002089 Sep 03 01:25:38.167799 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:25:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:25:38.591077 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-49939808-fb6f-43b4-be64-6ca94330ef10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "vcpus": 4, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:38.661595 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-49939808-fb6f-43b4-be64-6ca94330ef10 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.487242 Sep 03 01:25:38.662158 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1283 bytes} [Sat Sep 3 01:25:38 2022] POST /compute/v2.1/flavors => generated 404 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:25:38.674788 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-e36d33b4-7d38-4e11-ad3a-97826b1c32a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:38.768224 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-e36d33b4-7d38-4e11-ad3a-97826b1c32a2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097503 Sep 03 01:25:38.768981 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1336 bytes} [Sat Sep 3 01:25:38 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:25:41.683477 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-49939808-fb6f-43b4-be64-6ca94330ef10 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:41.684779 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-49939808-fb6f-43b4-be64-6ca94330ef10 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001926 Sep 03 01:25:41.685249 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:25:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:25:42.137370 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-fed1b020-d362-4fbc-ae3e-3e5a64d4d52a admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:42.164209 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-fed1b020-d362-4fbc-ae3e-3e5a64d4d52a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.471336 Sep 03 01:25:42.164970 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1292 bytes} [Sat Sep 3 01:25:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:25:44.710446 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-49939808-fb6f-43b4-be64-6ca94330ef10 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:44.712018 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-49939808-fb6f-43b4-be64-6ca94330ef10 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002098 Sep 03 01:25:44.712553 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:25:44 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:25:45.119738 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-28a83c1b-80c3-4e01-b545-926bf4010225 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "1", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "ram": 512, "disk": 1, "rxtx_factor": 1.0}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:45.192972 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-28a83c1b-80c3-4e01-b545-926bf4010225 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.472912 Sep 03 01:25:45.193540 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1283 bytes} [Sat Sep 3 01:25:44 2022] POST /compute/v2.1/flavors => generated 402 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 01:25:45.206039 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-4d3e94f3-c06b-4cd6-b7d8-64ae9a8cbd13 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:45.276425 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-4d3e94f3-c06b-4cd6-b7d8-64ae9a8cbd13 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074188 Sep 03 01:25:45.277283 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1333 bytes} [Sat Sep 3 01:25:45 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:25:47.675772 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-28a83c1b-80c3-4e01-b545-926bf4010225 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:47.676731 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-28a83c1b-80c3-4e01-b545-926bf4010225 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Sep 03 01:25:47.677137 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:25:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:25:48.065156 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-9a51dca7-5628-4a79-9eab-c5e838dacc76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "ram": 2048, "swap": 0, "disk": 20, "vcpus": 1}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:48.146786 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-9a51dca7-5628-4a79-9eab-c5e838dacc76 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.463053 Sep 03 01:25:48.147350 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1283 bytes} [Sat Sep 3 01:25:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:25:48.160285 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-fa74af39-7932-47e0-8428-4b21343820f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:48.240986 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-fa74af39-7932-47e0-8428-4b21343820f7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084276 Sep 03 01:25:48.241488 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1333 bytes} [Sat Sep 3 01:25:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:25:50.625828 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-9a51dca7-5628-4a79-9eab-c5e838dacc76 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:50.626908 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-9a51dca7-5628-4a79-9eab-c5e838dacc76 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Sep 03 01:25:50.627806 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:25:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:25:51.074384 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-cc2f0696-4fe9-4d62-89bc-9bce29229db3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "id": "3"}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:51.150330 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-cc2f0696-4fe9-4d62-89bc-9bce29229db3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.516521 Sep 03 01:25:51.150921 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1283 bytes} [Sat Sep 3 01:25:50 2022] POST /compute/v2.1/flavors => generated 406 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 01:25:51.163764 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-d1544610-a7d3-475f-8dfa-0312c38c5317 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:51.247512 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-d1544610-a7d3-475f-8dfa-0312c38c5317 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.087236 Sep 03 01:25:51.249054 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1333 bytes} [Sat Sep 3 01:25:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:25:53.629747 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-cc2f0696-4fe9-4d62-89bc-9bce29229db3 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:53.631189 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-cc2f0696-4fe9-4d62-89bc-9bce29229db3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 03 01:25:53.632000 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:25:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:25:54.081177 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-dd302752-4634-46dc-82da-cec1e0d3b9cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "rxtx_factor": 1.0, "vcpus": 4, "ram": 8192, "swap": 0, "disk": 80}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:54.088387 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:25:54.184652 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-dd302752-4634-46dc-82da-cec1e0d3b9cf admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.546612 Sep 03 01:25:54.185209 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1283 bytes} [Sat Sep 3 01:25:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:25:54.197615 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-dbbf553d-183a-4686-9c1e-13859efede28 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:54.273478 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-dbbf553d-183a-4686-9c1e-13859efede28 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079530 Sep 03 01:25:54.274264 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1333 bytes} [Sat Sep 3 01:25:54 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:25:56.712800 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-dd302752-4634-46dc-82da-cec1e0d3b9cf admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:25:56.713817 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-dd302752-4634-46dc-82da-cec1e0d3b9cf admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Sep 03 01:25:56.714216 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:25:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:25:57.158711 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-6b6512b4-2f79-4423-8a6a-3adba74573bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "vcpus": 8, "name": "m1.xlarge"}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:57.253247 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-6b6512b4-2f79-4423-8a6a-3adba74573bf admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.532771 Sep 03 01:25:57.253971 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1283 bytes} [Sat Sep 3 01:25:56 2022] POST /compute/v2.1/flavors => generated 408 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 01:25:57.266033 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-3c8508ec-d3f7-44af-a1ae-067730e3b77f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:25:57.334587 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-3c8508ec-d3f7-44af-a1ae-067730e3b77f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072300 Sep 03 01:25:57.335776 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1333 bytes} [Sat Sep 3 01:25:57 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:26:16.068818 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-6b6512b4-2f79-4423-8a6a-3adba74573bf admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:16.069836 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-6b6512b4-2f79-4423-8a6a-3adba74573bf admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 03 01:26:16.070238 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:26:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:26:16.457581 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-a047d28a-5c1a-48b6-9b14-340ab4dc8d56 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:16.475604 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-a047d28a-5c1a-48b6-9b14-340ab4dc8d56 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398669 Sep 03 01:26:16.476137 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1292 bytes} [Sat Sep 3 01:26:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:26:17.539414 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-6b6512b4-2f79-4423-8a6a-3adba74573bf admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:17.540420 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-6b6512b4-2f79-4423-8a6a-3adba74573bf admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 03 01:26:17.540812 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Sep 3 01:26:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:26:18.063879 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-10b0ad74-202a-43d7-9d60-3181fe63e2a6 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:18.069479 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.wsgi [None req-10b0ad74-202a-43d7-9d60-3181fe63e2a6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-10b0ad74-202a-43d7-9d60-3181fe63e2a6 admin admin] Request method failure captured: Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Accept: application/json Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Accept-Encoding: gzip, deflate Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Connection: keep-alive Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Content-Length: 0 Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Host: 10.222.0.13 Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Openstack-Api-Version: compute 2.92 Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Openstack-System-Scope: None Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: User-Agent: python-novaclient Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Auth-Token: gAAAAABjEq05HvNvUo0sr76aSO2x0Oq-hji33GsjLgg-rpAiQ9dkCqjEsPTztj3bOSJeGqjWLOiLNYTnLRvxm_PhFyCSCckJoAoKQ_iLrt2K5GYtcPABLesm-Wsci9mghtTpdkMek3XJE0rvma4YbjtSgocVcZOLW-RqUqOtBrknB-eVNDWwuDI Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Domain-Id: None Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Domain-Name: None Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Identity-Status: Confirmed Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Is-Admin-Project: True Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Project-Domain-Id: default Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Project-Domain-Name: Default Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Project-Id: 06b321cae6a24e3a9217594a16dab365 Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Project-Name: admin Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Role: member,reader,admin Sep 03 01:26:18.072752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Roles: member,reader,admin Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_06b321cae6a24e3a9217594a16dab365"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Tenant: admin Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Tenant-Id: 06b321cae6a24e3a9217594a16dab365 Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Tenant-Name: admin Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User: admin Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User-Domain-Id: default Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User-Domain-Name: Default Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User-Id: 3188ed8aefba4edeb5f28b0b4a901aed Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User-Name: admin Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: method: > Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: exception: Flavor 42 could not be found. Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: action_args: {'id': '42'} Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:26:18.074521 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:26:18.076252 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:18.077668 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-10b0ad74-202a-43d7-9d60-3181fe63e2a6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:26:18.078964 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-10b0ad74-202a-43d7-9d60-3181fe63e2a6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.396701 Sep 03 01:26:18.078964 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Sep 3 01:26:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 01:26:18.084424 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-71ccd3e8-1f00-4e91-a93b-467e91683204 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:18.088632 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:26:18.107028 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-71ccd3e8-1f00-4e91-a93b-467e91683204 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026109 Sep 03 01:26:18.107546 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Sep 3 01:26:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:26:18.117230 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-6f8aaf63-d691-40e3-8fff-d27c93173762 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:18.140570 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-6f8aaf63-d691-40e3-8fff-d27c93173762 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026907 Sep 03 01:26:18.141088 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Sep 3 01:26:18 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:26:18.150231 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-be25ed48-ee2e-4f82-b546-8fd48d87231a admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:18.157080 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.wsgi [None req-be25ed48-ee2e-4f82-b546-8fd48d87231a admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-be25ed48-ee2e-4f82-b546-8fd48d87231a admin admin] Request method failure captured: Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Accept: application/json Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Accept-Encoding: gzip, deflate Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Connection: keep-alive Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Content-Length: 0 Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Host: 10.222.0.13 Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Openstack-Api-Version: compute 2.92 Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Openstack-System-Scope: None Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: User-Agent: python-novaclient Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Auth-Token: gAAAAABjEq05HvNvUo0sr76aSO2x0Oq-hji33GsjLgg-rpAiQ9dkCqjEsPTztj3bOSJeGqjWLOiLNYTnLRvxm_PhFyCSCckJoAoKQ_iLrt2K5GYtcPABLesm-Wsci9mghtTpdkMek3XJE0rvma4YbjtSgocVcZOLW-RqUqOtBrknB-eVNDWwuDI Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Domain-Id: None Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Domain-Name: None Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Identity-Status: Confirmed Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Is-Admin-Project: True Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Project-Domain-Id: default Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Project-Domain-Name: Default Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Project-Id: 06b321cae6a24e3a9217594a16dab365 Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Project-Name: admin Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Role: member,reader,admin Sep 03 01:26:18.160343 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Roles: member,reader,admin Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_06b321cae6a24e3a9217594a16dab365"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Tenant: admin Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Tenant-Id: 06b321cae6a24e3a9217594a16dab365 Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Tenant-Name: admin Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User: admin Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User-Domain-Id: default Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User-Domain-Name: Default Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User-Id: 3188ed8aefba4edeb5f28b0b4a901aed Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User-Name: admin Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: method: > Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: exception: Flavor 42 could not be found. Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: action_args: {'id': '42'} Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:26:18.161948 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:26:18.166699 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:18.167815 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-be25ed48-ee2e-4f82-b546-8fd48d87231a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:26:18.168836 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-be25ed48-ee2e-4f82-b546-8fd48d87231a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015028 Sep 03 01:26:18.168836 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Sep 3 01:26:18 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 03 01:26:19.126455 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-6f8aaf63-d691-40e3-8fff-d27c93173762 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:19.127504 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-6f8aaf63-d691-40e3-8fff-d27c93173762 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Sep 03 01:26:19.127900 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Sep 3 01:26:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:26:19.650862 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-bef28667-d01a-4bf5-b7c6-162c1d4baeb0 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:19.657021 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.wsgi [None req-bef28667-d01a-4bf5-b7c6-162c1d4baeb0 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-bef28667-d01a-4bf5-b7c6-162c1d4baeb0 admin admin] Request method failure captured: Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Accept: application/json Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Accept-Encoding: gzip, deflate Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Connection: keep-alive Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Content-Length: 0 Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Host: 10.222.0.13 Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Openstack-Api-Version: compute 2.92 Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Openstack-System-Scope: None Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: User-Agent: python-novaclient Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Auth-Token: gAAAAABjEq07hBhAFYxPcGW16_ltv82xNzhX1fNwmVEXPt0ONZZAYQAYjlG0Vwz_xS5UwRlB9HLXxkqJGNKdbjmurBfDk6BICLXzmGt3FPS1Qo39RuOCO0QS2i_yl6haf8pjiQ_tEKuO9DLHzJbTitAca86HTCaaS1GKoADJwavFoSoLBv8rs40 Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Domain-Id: None Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Domain-Name: None Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Identity-Status: Confirmed Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Is-Admin-Project: True Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Project-Domain-Id: default Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Project-Domain-Name: Default Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Project-Id: 06b321cae6a24e3a9217594a16dab365 Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Project-Name: admin Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Role: member,reader,admin Sep 03 01:26:19.658569 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Roles: member,reader,admin Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_06b321cae6a24e3a9217594a16dab365"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Tenant: admin Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Tenant-Id: 06b321cae6a24e3a9217594a16dab365 Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Tenant-Name: admin Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User: admin Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User-Domain-Id: default Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User-Domain-Name: Default Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User-Id: 3188ed8aefba4edeb5f28b0b4a901aed Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User-Name: admin Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: method: > Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: exception: Flavor 84 could not be found. Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: action_args: {'id': '84'} Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:26:19.660147 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:26:19.661087 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:19.662425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-bef28667-d01a-4bf5-b7c6-162c1d4baeb0 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:26:19.663663 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-bef28667-d01a-4bf5-b7c6-162c1d4baeb0 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.395304 Sep 03 01:26:19.663663 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Sep 3 01:26:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 01:26:19.670268 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-2bcb0aca-0313-4167-8197-6a72a3fb9dc5 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:19.685702 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-2bcb0aca-0313-4167-8197-6a72a3fb9dc5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019024 Sep 03 01:26:19.686325 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Sep 3 01:26:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:26:19.695765 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-17703883-c192-46ba-8767-629f13ef3318 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:19.711453 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-17703883-c192-46ba-8767-629f13ef3318 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019200 Sep 03 01:26:19.712002 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Sep 3 01:26:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:26:19.721360 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-73071978-fff4-4fc9-aa06-52d0e1b5d9ce admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:19.726765 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.wsgi [None req-73071978-fff4-4fc9-aa06-52d0e1b5d9ce admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-73071978-fff4-4fc9-aa06-52d0e1b5d9ce admin admin] Request method failure captured: Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Accept: application/json Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Accept-Encoding: gzip, deflate Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Connection: keep-alive Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Content-Length: 0 Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Host: 10.222.0.13 Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Openstack-Api-Version: compute 2.92 Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Openstack-System-Scope: None Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: User-Agent: python-novaclient Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Auth-Token: gAAAAABjEq07hBhAFYxPcGW16_ltv82xNzhX1fNwmVEXPt0ONZZAYQAYjlG0Vwz_xS5UwRlB9HLXxkqJGNKdbjmurBfDk6BICLXzmGt3FPS1Qo39RuOCO0QS2i_yl6haf8pjiQ_tEKuO9DLHzJbTitAca86HTCaaS1GKoADJwavFoSoLBv8rs40 Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Domain-Id: None Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Domain-Name: None Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Identity-Status: Confirmed Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Is-Admin-Project: True Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Project-Domain-Id: default Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Project-Domain-Name: Default Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Project-Id: 06b321cae6a24e3a9217594a16dab365 Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Project-Name: admin Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Role: member,reader,admin Sep 03 01:26:19.728296 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Roles: member,reader,admin Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_06b321cae6a24e3a9217594a16dab365"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Tenant: admin Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Tenant-Id: 06b321cae6a24e3a9217594a16dab365 Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Tenant-Name: admin Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User: admin Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User-Domain-Id: default Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User-Domain-Name: Default Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User-Id: 3188ed8aefba4edeb5f28b0b4a901aed Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User-Name: admin Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: method: > Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: exception: Flavor 84 could not be found. Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: action_args: {'id': '84'} Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:26:19.729942 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:26:19.730896 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:19.731998 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-73071978-fff4-4fc9-aa06-52d0e1b5d9ce admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:26:19.733139 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-73071978-fff4-4fc9-aa06-52d0e1b5d9ce admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012026 Sep 03 01:26:19.733139 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Sep 3 01:26:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 03 01:26:20.696701 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-17703883-c192-46ba-8767-629f13ef3318 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:20.697700 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-17703883-c192-46ba-8767-629f13ef3318 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 03 01:26:20.698092 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Sep 3 01:26:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:26:21.224064 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-fbbf369b-691f-4548-aff4-5b2c58353899 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:21.229802 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.wsgi [None req-fbbf369b-691f-4548-aff4-5b2c58353899 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-fbbf369b-691f-4548-aff4-5b2c58353899 admin admin] Request method failure captured: Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Accept: application/json Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Accept-Encoding: gzip, deflate Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Connection: keep-alive Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Content-Length: 0 Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Host: 10.222.0.13 Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Openstack-Api-Version: compute 2.92 Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Openstack-System-Scope: None Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: User-Agent: python-novaclient Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Auth-Token: gAAAAABjEq080IFX2fxW_VPtaN7WUXg27T3JY6g4lPieSUAIWZLu8V1sBWaZkZdGZPNRPeJRNTEITHgAxT0gEys401SmXVpmfYWCZYVustiPWhr5ABOhrH_9TfZXY85DBEhQ-oo0CKeK9TJi53rjqBICSzJJrZwYsfBZsOnrh8fJAg7OHTWZsxU Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Domain-Id: None Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Domain-Name: None Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Identity-Status: Confirmed Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Is-Admin-Project: True Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Project-Domain-Id: default Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Project-Domain-Name: Default Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Project-Id: 06b321cae6a24e3a9217594a16dab365 Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Project-Name: admin Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Role: member,reader,admin Sep 03 01:26:21.231317 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Roles: member,reader,admin Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_06b321cae6a24e3a9217594a16dab365"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Tenant: admin Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Tenant-Id: 06b321cae6a24e3a9217594a16dab365 Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-Tenant-Name: admin Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User: admin Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User-Domain-Id: default Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User-Domain-Name: Default Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User-Id: 3188ed8aefba4edeb5f28b0b4a901aed Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: X-User-Name: admin Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: method: > Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: exception: Flavor 451 could not be found. Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: action_args: {'id': '451'} Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:26:21.233921 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:26:21.235053 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: ERROR nova.api.openstack.wsgi Sep 03 01:26:21.236428 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-fbbf369b-691f-4548-aff4-5b2c58353899 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105894) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:26:21.237789 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-fbbf369b-691f-4548-aff4-5b2c58353899 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.396043 Sep 03 01:26:21.237789 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Sep 3 01:26:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 397 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 03 01:26:21.242942 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-15be1957-1706-4115-80f9-b4d29e6aab96 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:21.258059 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-15be1957-1706-4115-80f9-b4d29e6aab96 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018688 Sep 03 01:26:21.258636 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Sep 3 01:26:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:26:21.268657 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:21.284338 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019232 Sep 03 01:26:21.284870 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Sep 3 01:26:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:26:21.293888 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-0e5c4a10-2271-414b-ab6a-3880c1317c5d admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:21.299205 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.wsgi [None req-0e5c4a10-2271-414b-ab6a-3880c1317c5d admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-0e5c4a10-2271-414b-ab6a-3880c1317c5d admin admin] Request method failure captured: Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Accept: application/json Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Accept-Encoding: gzip, deflate Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Connection: keep-alive Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Content-Length: 0 Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Host: 10.222.0.13 Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Openstack-Api-Version: compute 2.92 Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Openstack-System-Scope: None Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: User-Agent: python-novaclient Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Auth-Token: gAAAAABjEq080IFX2fxW_VPtaN7WUXg27T3JY6g4lPieSUAIWZLu8V1sBWaZkZdGZPNRPeJRNTEITHgAxT0gEys401SmXVpmfYWCZYVustiPWhr5ABOhrH_9TfZXY85DBEhQ-oo0CKeK9TJi53rjqBICSzJJrZwYsfBZsOnrh8fJAg7OHTWZsxU Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Domain-Id: None Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Domain-Name: None Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Identity-Status: Confirmed Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Is-Admin-Project: True Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Openstack-Nova-Api-Version: 2.92 Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Project-Domain-Id: default Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Project-Domain-Name: Default Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Project-Id: 06b321cae6a24e3a9217594a16dab365 Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Project-Name: admin Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Role: member,reader,admin Sep 03 01:26:21.300695 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Roles: member,reader,admin Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_06b321cae6a24e3a9217594a16dab365"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/06b321cae6a24e3a9217594a16dab365"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Tenant: admin Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Tenant-Id: 06b321cae6a24e3a9217594a16dab365 Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-Tenant-Name: admin Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User: admin Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User-Domain-Id: default Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User-Domain-Name: Default Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User-Id: 3188ed8aefba4edeb5f28b0b4a901aed Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: X-User-Name: admin Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: method: > Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: exception: Flavor 451 could not be found. Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: action_args: {'id': '451'} Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:26:21.302240 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:26:21.303151 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: ERROR nova.api.openstack.wsgi Sep 03 01:26:21.304276 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-0e5c4a10-2271-414b-ab6a-3880c1317c5d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105895) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:26:21.305290 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-0e5c4a10-2271-414b-ab6a-3880c1317c5d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011635 Sep 03 01:26:21.305290 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Sep 3 01:26:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 03 01:26:22.269974 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:22.271027 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 03 01:26:22.271527 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Sep 3 01:26:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:26:22.793872 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-375bb297-1784-48ba-9c12-7af6858dedd2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:26:22.889804 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-375bb297-1784-48ba-9c12-7af6858dedd2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.477094 Sep 03 01:26:22.890378 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Sep 3 01:26:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:26:23.861809 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:23.862861 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 03 01:26:23.863260 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Sep 3 01:26:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:26:24.387353 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-9f8129dc-a0ed-40d4-b62f-6cffaaf70e2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:26:24.467545 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-9f8129dc-a0ed-40d4-b62f-6cffaaf70e2b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.467794 Sep 03 01:26:24.468101 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Sep 3 01:26:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:26:25.430533 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:25.431553 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 03 01:26:25.431951 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Sep 3 01:26:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:26:25.962655 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-39977b77-3008-46d7-b2a2-11c8acad7f28 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:26:26.043366 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-39977b77-3008-46d7-b2a2-11c8acad7f28 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.471265 Sep 03 01:26:26.044435 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Sep 3 01:26:25 2022] POST /compute/v2.1/flavors => generated 407 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:26:27.022701 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:27.023745 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Sep 03 01:26:27.024150 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Sep 3 01:26:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:26:27.548558 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-a4f0ff2c-476e-4fe6-9d92-8143c05bd173 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:26:27.602887 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-a4f0ff2c-476e-4fe6-9d92-8143c05bd173 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.433194 Sep 03 01:26:27.603468 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Sep 3 01:26:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 01:26:28.581752 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:28.582792 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 03 01:26:28.583188 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Sep 3 01:26:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:26:29.108039 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-5525a4f7-7343-4ff3-9188-b3acd8b85592 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:26:29.128759 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-5525a4f7-7343-4ff3-9188-b3acd8b85592 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.407508 Sep 03 01:26:29.129288 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Sat Sep 3 01:26:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:27:23.085824 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:27:23.086817 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-3d7c7344-f6be-4326-b12e-426b4080e7ea admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Sep 03 01:27:23.087239 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 931 bytes} [Sat Sep 3 01:27:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:27:23.097794 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:23.473601 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-85a29871-a8cc-451c-9ea8-46ca73b2bf26 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:27:23.494122 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-85a29871-a8cc-451c-9ea8-46ca73b2bf26 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.400744 Sep 03 01:27:23.494679 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1292 bytes} [Sat Sep 3 01:27:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:27:23.516819 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG dbcounter [-] [105894] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105894) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:27:23.520588 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-8f76a86b-a101-4d0a-a6ae-6e849da76cb4 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:27:23.529372 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-8f76a86b-a101-4d0a-a6ae-6e849da76cb4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014624 Sep 03 01:27:23.529902 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1283 bytes} [Sat Sep 3 01:27:23 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:27:23.542758 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-355d0c2d-8242-4444-b9d4-315aa933ddd2 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:27:23.551440 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-355d0c2d-8242-4444-b9d4-315aa933ddd2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012936 Sep 03 01:27:23.552003 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1286 bytes} [Sat Sep 3 01:27:23 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:27:23.563567 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-801eac60-6218-4ce2-aa34-ff4afd6c3c38 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:27:23.572328 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-801eac60-6218-4ce2-aa34-ff4afd6c3c38 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011235 Sep 03 01:27:23.572328 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1286 bytes} [Sat Sep 3 01:27:23 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:27:23.583841 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-c5ef05e6-aa10-4286-9a93-d64bf8dc1f42 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:27:23.593714 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-c5ef05e6-aa10-4286-9a93-d64bf8dc1f42 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013340 Sep 03 01:27:23.594251 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1283 bytes} [Sat Sep 3 01:27:23 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:30:52.741727 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-801eac60-6218-4ce2-aa34-ff4afd6c3c38 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:30:52.742959 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-801eac60-6218-4ce2-aa34-ff4afd6c3c38 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001618 Sep 03 01:30:52.743356 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Sep 3 01:30:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:30:52.886468 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writing DB stats nova_api:SELECT=6 {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:30:53.057425 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-187dda3c-8bfb-47ac-bc77-dffaf48926f0 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:30:53.060779 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-187dda3c-8bfb-47ac-bc77-dffaf48926f0 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:30:53.062538 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-187dda3c-8bfb-47ac-bc77-dffaf48926f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:30:53.063038 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-187dda3c-8bfb-47ac-bc77-dffaf48926f0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:30:53.063823 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-187dda3c-8bfb-47ac-bc77-dffaf48926f0 admin admin] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:30:53.064281 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-187dda3c-8bfb-47ac-bc77-dffaf48926f0 admin admin] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:30:53.064709 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-187dda3c-8bfb-47ac-bc77-dffaf48926f0 admin admin] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:30:53.097668 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-187dda3c-8bfb-47ac-bc77-dffaf48926f0 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.212764 Sep 03 01:30:53.098498 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Sep 3 01:30:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:30:53.974735 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-801eac60-6218-4ce2-aa34-ff4afd6c3c38 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:30:53.975760 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-801eac60-6218-4ce2-aa34-ff4afd6c3c38 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Sep 03 01:30:53.976171 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Sep 3 01:30:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:30:54.174792 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-ffb50815-25c2-48c8-8f30-6f13f6e7e3a1 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:30:54.178282 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-ffb50815-25c2-48c8-8f30-6f13f6e7e3a1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:30:54.178741 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-ffb50815-25c2-48c8-8f30-6f13f6e7e3a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:30:54.179234 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-ffb50815-25c2-48c8-8f30-6f13f6e7e3a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:30:54.179965 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-ffb50815-25c2-48c8-8f30-6f13f6e7e3a1 admin admin] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:30:54.180483 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-ffb50815-25c2-48c8-8f30-6f13f6e7e3a1 admin admin] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:30:54.180936 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-ffb50815-25c2-48c8-8f30-6f13f6e7e3a1 admin admin] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:30:54.200529 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-ffb50815-25c2-48c8-8f30-6f13f6e7e3a1 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.083559 Sep 03 01:30:54.201096 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Sep 3 01:30:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:31:05.454815 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-801eac60-6218-4ce2-aa34-ff4afd6c3c38 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:31:05.455861 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-801eac60-6218-4ce2-aa34-ff4afd6c3c38 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 03 01:31:05.456256 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Sep 3 01:31:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:31:05.601349 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writing DB stats nova_cell0:SELECT=4 {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:31:05.602073 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writing DB stats nova_cell1:SELECT=4 {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:31:05.602705 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG dbcounter [-] [105895] Writing DB stats nova_api:SELECT=8 {{(pid=105895) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:31:05.650037 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-8fb64755-0026-4961-943e-f704e8173139 admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:31:05.653426 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-8fb64755-0026-4961-943e-f704e8173139 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:31:05.653907 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-8fb64755-0026-4961-943e-f704e8173139 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:31:05.654672 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-8fb64755-0026-4961-943e-f704e8173139 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:31:05.655389 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-8fb64755-0026-4961-943e-f704e8173139 admin admin] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:31:05.655839 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-8fb64755-0026-4961-943e-f704e8173139 admin admin] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:31:05.656260 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-8fb64755-0026-4961-943e-f704e8173139 admin admin] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:31:05.683280 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-8fb64755-0026-4961-943e-f704e8173139 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.086138 Sep 03 01:31:05.683779 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Sep 3 01:31:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:31:06.516580 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: DEBUG nova.api.openstack.wsgi [None req-801eac60-6218-4ce2-aa34-ff4afd6c3c38 admin admin] Calling method '>' {{(pid=105894) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:31:06.517667 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: INFO nova.api.openstack.requestlog [None req-801eac60-6218-4ce2-aa34-ff4afd6c3c38 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Sep 03 01:31:06.518106 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: [pid: 105894|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Sep 3 01:31:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:31:06.713429 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG nova.api.openstack.wsgi [None req-6962e148-d141-4e9e-8249-6c0d966a6bbb admin admin] Calling method '>' {{(pid=105895) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:31:06.716842 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-6962e148-d141-4e9e-8249-6c0d966a6bbb admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:31:06.717327 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-6962e148-d141-4e9e-8249-6c0d966a6bbb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:31:06.717892 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-6962e148-d141-4e9e-8249-6c0d966a6bbb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:31:06.718654 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-6962e148-d141-4e9e-8249-6c0d966a6bbb admin admin] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:31:06.719109 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-6962e148-d141-4e9e-8249-6c0d966a6bbb admin admin] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:31:06.719531 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: DEBUG oslo_concurrency.lockutils [None req-6962e148-d141-4e9e-8249-6c0d966a6bbb admin admin] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105895) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:31:06.742854 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: INFO nova.api.openstack.requestlog [None req-6962e148-d141-4e9e-8249-6c0d966a6bbb admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.084733 Sep 03 01:31:06.743335 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: [pid: 105895|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Sep 3 01:31:06 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:32:06.352249 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: Sat Sep 3 01:32:06 2022 - graceful shutdown triggered... Sep 03 01:32:06.352489 dv-cinder-838009-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 03 01:32:06.353179 dv-cinder-838009-7-iscsi devstack@n-api.service[105895]: Gracefully killing worker 2 (pid: 105895)... Sep 03 01:32:06.353550 dv-cinder-838009-7-iscsi devstack@n-api.service[105894]: Gracefully killing worker 1 (pid: 105894)... Sep 03 01:32:07.353391 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: worker 1 buried after 1 seconds Sep 03 01:32:07.353921 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: worker 2 buried after 1 seconds Sep 03 01:32:07.353921 dv-cinder-838009-7-iscsi devstack@n-api.service[105881]: goodbye to uWSGI. Sep 03 01:32:07.355677 dv-cinder-838009-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 03 01:32:07.356219 dv-cinder-838009-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 03 01:32:07.359099 dv-cinder-838009-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 03 01:32:07.370922 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 03 01:32:07.373000 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 3 01:32:07 2022] *** Sep 03 01:32:07.373000 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 03 01:32:07.373000 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 03 01:32:07.373000 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: nodename: dv-cinder-838009-7-iscsi Sep 03 01:32:07.373000 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: machine: x86_64 Sep 03 01:32:07.373000 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: clock source: unix Sep 03 01:32:07.373000 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: pcre jit disabled Sep 03 01:32:07.373000 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: detected number of CPU cores: 4 Sep 03 01:32:07.373000 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: current working directory: / Sep 03 01:32:07.373000 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: detected binary path: /usr/bin/uwsgi-core Sep 03 01:32:07.373794 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: your processes number limit is 47680 Sep 03 01:32:07.373794 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: your memory page size is 4096 bytes Sep 03 01:32:07.373794 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: detected max file descriptor number: 2048 Sep 03 01:32:07.373794 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: lock engine: pthread robust mutexes Sep 03 01:32:07.373794 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: thunder lock: enabled Sep 03 01:32:07.373794 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 03 01:32:07.373794 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 03 01:32:07.413261 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: Python main interpreter initialized at 0x55f0fbc989c0 Sep 03 01:32:07.413261 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: python threads support enabled Sep 03 01:32:07.413261 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: your server socket listen backlog is limited to 100 connections Sep 03 01:32:07.413261 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: your mercy for graceful operations on workers is 90 seconds Sep 03 01:32:07.413714 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: mapped 403077 bytes (393 KB) for 2 cores Sep 03 01:32:07.413714 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: *** Operational MODE: preforking *** Sep 03 01:32:07.414153 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: *** uWSGI is running in multiple interpreter mode *** Sep 03 01:32:07.414153 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: spawned uWSGI master process (pid: 127528) Sep 03 01:32:07.414204 dv-cinder-838009-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 03 01:32:07.416211 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: spawned uWSGI worker 1 (pid: 127552, cores: 1) Sep 03 01:32:07.416211 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: spawned uWSGI worker 2 (pid: 127553, cores: 1) Sep 03 01:32:07.416211 dv-cinder-838009-7-iscsi devstack@n-api.service[127528]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 03 01:32:08.095444 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 03 01:32:08.099971 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 03 01:32:09.264936 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 01:32:09.264936 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: from cryptography.utils import int_from_bytes Sep 03 01:32:09.265552 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 01:32:09.265552 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: from cryptography.utils import int_from_bytes Sep 03 01:32:09.273645 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 01:32:09.273645 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: from cryptography.utils import int_from_bytes Sep 03 01:32:09.274087 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 03 01:32:09.274087 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: from cryptography.utils import int_from_bytes Sep 03 01:32:11.691590 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 01:32:11.692162 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 01:32:11.692419 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 01:32:11.692729 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 01:32:11.692993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 01:32:11.693393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.693717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.694035 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.694425 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.694541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 03 01:32:11.694912 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.695001 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 03 01:32:11.695082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.695301 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.695407 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 03 01:32:11.695614 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.695730 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 03 01:32:11.695906 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 03 01:32:11.696014 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.696174 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.696269 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.696485 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.696595 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.696906 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.697029 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-838009-7-iscsi {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.697221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.697328 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.697540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.697649 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.697853 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.697963 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.698867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.699025 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.699618 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.699785 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.699785 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.700073 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.700227 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.700394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.700394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.700760 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.700934 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-838009-7-iscsi {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.700934 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.701230 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.701551 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.701751 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.702071 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.702235 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.702425 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.702677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.702867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.703036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.703228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.703413 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.703665 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.703856 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.704031 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.704283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.704618 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.704819 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.705044 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-838009-7-iscsi {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.705206 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.705371 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.705716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.705882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.706487 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.710149 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.710248 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.710330 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.710444 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.710525 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.710799 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.711053 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.711217 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.711377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.711612 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.711777 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.711975 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.712127 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.712274 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.712433 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.712592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.712592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.712927 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-838009-7-iscsi {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.713085 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.713233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.713389 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.713553 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.714325 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.714512 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.714660 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.714818 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.715040 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.715212 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.715359 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.715515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.715662 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.715857 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.716036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.716211 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.716418 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.716570 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.716724 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.716879 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.717073 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.717234 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.717389 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.717551 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.717704 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.717704 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.718014 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.718186 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.718357 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.718524 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.718672 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.718672 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.718967 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.720301 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.720514 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.720720 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.720883 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.721117 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.721275 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.721430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.721588 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.721751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.721907 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.722069 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.722216 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.722422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.722587 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.722740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.722898 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.723061 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.723061 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.723603 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.723783 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.723932 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.723932 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.724234 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.724557 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.724723 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.724723 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.725014 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.725170 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.725329 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.725478 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.725674 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.725843 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.725989 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.726148 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.726295 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.726476 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.726624 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.726842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.726995 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.727154 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.727347 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.727498 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.727645 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.729139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.729736 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.729941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.730123 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.730481 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.730721 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.730972 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.731137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.731292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.731447 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.731594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.731748 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.731748 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.732115 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.732289 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.732444 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.732600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.732756 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.732902 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.733057 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.733204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.733356 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.733510 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.733664 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.733825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.734013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.734204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.734400 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.734554 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.734714 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.734872 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.735110 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.735266 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.735425 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.735551 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.735673 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.735805 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.735921 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.736070 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.736222 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.736343 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.736503 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.736629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.736751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.736864 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.736986 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.737105 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.737228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.737349 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.737502 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.737632 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.737754 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.737899 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.742587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.742727 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.742813 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.742895 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.742975 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.742975 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.743125 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.743220 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.743303 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.743383 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.743461 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.743531 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.743620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.743694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.743763 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.743831 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.743906 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.743991 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.744063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.744140 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.744210 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.744308 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.744386 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.744493 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.744566 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.744642 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.744720 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.744791 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.744859 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.744978 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.745127 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.745200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.745279 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.745351 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.745421 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.745497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.745574 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.745652 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.745733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.745804 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.745880 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.745950 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.746025 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.746025 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.746165 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.746237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.746305 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.746435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.746519 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.746519 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.746657 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.746732 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.746802 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.746890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.746962 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.747044 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.747122 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.747198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.747267 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.747336 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.747412 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.747492 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.747569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.747648 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.747718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.747795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.747865 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.747948 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.748019 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.748088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.748163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.748234 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.748311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.748388 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.748458 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.748539 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.748623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.748695 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.748777 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.748854 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.748932 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.749008 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.749079 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.749147 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 03 01:32:11.749289 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.749373 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.749452 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.749524 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.749618 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.749736 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.749810 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.749878 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.749947 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.750015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.750084 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.750166 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.750245 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.750322 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.750425 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.750498 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.750580 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.750663 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.750747 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.750826 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.750896 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.750965 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.751034 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.751102 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.751182 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.751268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.751339 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.751409 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.751484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.751561 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.751645 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.751717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.751794 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.751872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.751949 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.752031 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.752108 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.752208 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.752286 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.752357 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.752433 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.752516 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.752588 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.752665 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.752735 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.752817 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.752895 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.752977 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.753055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.753132 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.753209 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.753287 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.753357 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.753441 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.753521 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.753597 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.753668 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.753736 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.753813 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.753896 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.753967 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.754042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.754112 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.754188 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.754271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.754371 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.754447 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.754527 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.754598 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.754687 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.754772 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.754851 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.754921 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.754990 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.755057 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.755133 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.755216 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.755287 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.755356 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.755432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.755509 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.755579 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.755660 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.755731 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.755807 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.755884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.755954 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.756035 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.756113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.756190 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.756445 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.756553 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.756635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.756720 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.759238 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.759406 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.759525 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.759639 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.759766 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.759910 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.760026 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.760137 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.760247 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.760377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.760490 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.761178 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.761304 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.761430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.761557 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.761682 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.761809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.761930 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.762091 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.762240 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.762430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.762594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.762756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.762914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.763060 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.763205 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.763393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.763548 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.763703 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.763849 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.763849 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.764145 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.764145 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.764460 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.764460 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.764756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.764919 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.765071 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.765258 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.765422 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.765615 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.765760 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.765858 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.765943 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.766026 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.766124 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.766209 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.766293 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.766543 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.766648 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.766734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.767633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.767744 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.767744 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.767912 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.768141 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.768406 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.768506 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.768631 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.768725 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.768808 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.768890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.768986 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.769102 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.769401 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.769498 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.769592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.769684 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.769778 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.769863 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.769954 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.770047 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.770131 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.770131 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.770470 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.770561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.770662 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.770755 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.770839 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.770922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.771019 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.771104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.771194 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.771279 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.771361 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.771452 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.771544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.771627 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.771710 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.771800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.771883 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.771975 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.772066 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.772158 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.772248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.772338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.772436 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.772529 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.772621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.772749 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.772853 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.773047 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.773139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.773349 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.773446 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.773670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.773763 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.773977 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.774078 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.774280 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.774391 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.774614 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.774720 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.774916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.775018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.775224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.775322 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.775534 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.775636 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.775852 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.775954 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.776213 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.776310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.776631 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.776744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.776959 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.777061 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.777275 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.777369 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.777594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.777694 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.777948 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.778053 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.778257 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.778550 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.778648 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.778732 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.778920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.779024 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.779253 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.779360 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.779870 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.779973 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.780135 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.780230 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.780442 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.780542 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.780760 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.780860 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.781067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.781161 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.781376 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.781483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.781679 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.781779 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.781984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.782085 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.782299 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.782425 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.782646 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.782750 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.782963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.783056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.783271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.783371 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.783580 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.783681 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.783885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.783985 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.784191 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.784284 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.784491 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.784591 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.784798 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.784897 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.785106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.785200 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.785424 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.785526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.785733 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.785826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.786050 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.786162 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.786374 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.786486 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.786704 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.786807 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.787004 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.787357 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.787626 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.787931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.788022 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.788329 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.788433 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.788660 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.788750 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.788860 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.788944 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.789174 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.789255 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.789491 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.789607 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.789805 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.789914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.790113 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.790214 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.790451 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.790557 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.790884 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.791198 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.791506 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.792383 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.792556 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.792661 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.792955 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.793061 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.793268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.793369 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.793593 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.793688 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.793914 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.794007 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.794219 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.794314 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.794560 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.794666 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.794886 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.794996 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.795203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.795307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.795512 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.795612 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.795834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.795944 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.796133 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.796251 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.796458 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.796562 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.796777 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.796938 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.797106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.797272 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.797433 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.797614 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.797747 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.797878 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.801732 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.801906 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.802047 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.802189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.802331 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.802492 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.802633 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.802779 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.802918 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.803060 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.803199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.803329 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.803537 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.803679 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.803818 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.803957 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.804090 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.804781 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.804925 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.805057 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.805200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.805339 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.805477 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.805616 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.805748 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.805900 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.806046 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.806179 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.806318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.806531 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.806692 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.807493 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.808145 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.808281 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.808428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.808560 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.808700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.808700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.809049 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.809178 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.809307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.809428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.809540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.809652 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.809771 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.809892 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.810018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.810141 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.810266 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.810413 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.810532 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.810658 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.810778 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.810898 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.811010 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.811136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.811249 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.811249 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.811458 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.811575 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.811880 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.812013 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.812127 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.812238 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.812238 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.812447 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.812558 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.812684 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.812805 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.812926 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.813049 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.813163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.813283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.813283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.813493 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.813701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.813834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.813956 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.814078 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.814192 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.814311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.814460 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.814594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.814756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.814883 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.815004 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.815123 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.815249 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.815361 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.815471 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.815582 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.815692 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.815853 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.816006 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.816151 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.816290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.816422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.816422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.816683 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.816863 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.816997 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.817119 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.817231 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.817351 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.817555 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.817692 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.817814 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.817935 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.818048 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.818160 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.818286 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.818450 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.818663 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.818860 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.819042 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.819256 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.819402 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.819524 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.819638 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.819758 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.819882 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.820003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.820134 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.820249 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.820363 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.820475 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.820595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.820707 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.820834 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.820834 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.821091 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.821218 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.821218 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.821446 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.821560 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.821687 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.821817 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.821817 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.822268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.822521 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.822521 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.822748 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.822867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.822867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.823221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.823428 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.823428 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.823665 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.823824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.823824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.824196 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.824440 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.824613 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.824794 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.824794 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.825013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.825135 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.825286 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.825407 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.825527 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.825647 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.825647 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.825919 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.826125 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.826331 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.830469 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.830587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.830681 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.830807 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.830897 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.830992 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.831078 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.831078 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.832496 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.832600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.832699 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.832786 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.832879 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.832879 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.833055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.833142 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.833227 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.833311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.833402 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.833497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.833598 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.833684 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.834546 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.834646 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.834733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.834733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.834910 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.835006 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.835095 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.835188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.835281 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.835378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.835547 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.835547 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.835709 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.835796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.835889 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.835889 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.836057 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.836143 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.836236 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.836322 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.836426 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.838607 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.838756 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.838862 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.839873 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.840033 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.840212 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.840395 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.840575 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.840746 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.840925 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.841098 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.841098 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.841413 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.841579 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.841765 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.841935 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.842109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.842284 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.842463 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.842569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.842666 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.842769 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.842858 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.842858 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.843027 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.843122 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.843215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.843302 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.843387 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.843387 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.843560 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.843648 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.843740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.843838 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.843925 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.844089 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.844187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.844273 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.844367 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.844452 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.844550 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.844645 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.844645 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.853469 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.853560 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.853647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.853756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.853845 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.853931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.854024 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.854109 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.854193 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.854921 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.855023 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.855126 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.855215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.855299 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.855391 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.855491 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.855579 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.855664 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.855750 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.855834 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.855928 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.856023 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.856023 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.856188 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.856273 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.856357 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.856457 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.856550 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.856636 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.856720 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.856812 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.856897 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.856991 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.857085 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.857170 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.857262 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.857355 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.857450 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.857546 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.857632 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.857717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.857810 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.857903 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.858002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.858099 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.858187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.858273 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.858397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.858501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.858610 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.858706 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.858799 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.858893 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.858979 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.859064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.859153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.859239 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.859324 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.859417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.859511 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.859604 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.859705 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.859800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.859885 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.859969 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.860061 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.860146 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.860239 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.860324 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.860409 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.860492 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.860584 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.860680 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.860766 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.860851 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.860935 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.861019 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.861112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.861213 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.861299 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.861383 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.861475 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.861568 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.861653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.861747 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.861834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.861918 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.861918 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.862067 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.862152 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.862249 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.862249 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.862485 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.862580 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.862666 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.862666 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.862853 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.862948 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.863043 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.863135 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.863221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.863314 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.863408 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.863501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.863586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.863669 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.863761 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.863859 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.863946 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.864037 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.864131 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.864224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.864308 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.864405 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.864498 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.864583 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.864666 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.864758 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.864855 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.864957 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.865038 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.865118 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.865203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.865285 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.865377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.865463 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.865553 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.865652 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.865816 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.865905 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.865998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.866090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.866185 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.866279 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.866513 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.866619 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.866708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.866793 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.866878 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.866969 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.867068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.867162 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.867247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.867331 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.867423 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.867508 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.867601 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.867694 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.867787 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.867873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.868007 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.868155 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.868279 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.868391 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.868529 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.868668 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.868807 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.868948 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.869071 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.869196 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.869326 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.869457 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.869457 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.869703 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.869842 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.870579 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.870721 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.870856 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.871015 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.871204 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.871340 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.871472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.871611 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.871751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.871892 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.872033 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.872172 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.872318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.872459 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.872592 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.872737 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.872870 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.873008 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.873139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.873272 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.873410 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.873556 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.873556 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.873801 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.873801 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.874056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.874196 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.874392 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.874528 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.874659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.874790 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.874922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.874922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.874922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.874922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.875427 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.875566 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.875698 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.875838 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.875969 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.876100 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.876100 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.876100 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.876100 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.876620 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.876752 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.876883 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.877002 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.877115 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.877245 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.877385 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.877526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.877526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.877526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.877526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.878039 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.878171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.878309 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.878455 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.878599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.878731 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.878870 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.879003 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.879003 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.879003 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.879003 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.879474 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.879597 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.879719 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.879832 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.879953 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.880065 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.880204 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.880350 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.880489 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.880630 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.880770 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.880909 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.881054 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.881187 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.881317 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.881455 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.881594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.881734 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.881864 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.882003 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.882142 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.882277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.882436 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.882569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.882569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.882828 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.882960 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.883090 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.883228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.883360 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.883505 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.883646 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.883786 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.883917 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.884047 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.884187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.884187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.884444 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.884585 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.884717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.884857 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.884998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.885130 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.885261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.885391 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.885547 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.885695 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.885901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.886063 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.886197 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.886328 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.886492 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.886638 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.886777 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.886918 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.887047 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.887179 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.887309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.887454 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.887586 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.887717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.887855 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.887988 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.888119 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.888263 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.888395 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.888533 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.888672 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.888794 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.888930 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.889107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.889245 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.889435 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.889578 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.889746 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.889883 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.890054 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.890191 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.890380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.890533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.890691 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.891010 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.891161 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.891295 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.891433 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.891573 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.891715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.891855 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.891987 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.892124 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.892257 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.892390 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.892534 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.892666 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.892845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.892990 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.893224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.893379 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.893522 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.893662 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.893842 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.893984 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.894125 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.894260 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.894446 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.894588 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.894729 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.894861 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.895010 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.895156 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.895290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.895422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.895598 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.895735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.896117 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.896268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.896428 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.896565 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.896757 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.896901 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.897080 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.897230 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.897377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.897515 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.897698 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.897835 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.898010 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.898145 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.898322 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.898469 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.898655 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.898788 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.898958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.899095 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.899267 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.899404 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.899573 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.899710 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.899874 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.900004 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.900192 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.900319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.900499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.900636 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.900806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.900950 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.901124 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.901358 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.901573 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.901741 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.901912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.902054 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.902201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.902401 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.902537 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.902684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.902818 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.902960 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.903092 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.903348 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.903510 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.903633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.903755 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.903874 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.903994 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.904191 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.904337 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.904499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.904893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.905057 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.905193 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.905369 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.905517 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.905679 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.905825 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.905983 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.906126 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.906287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.906462 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.906620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.906765 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.906927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.907065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.907230 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.907366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.907536 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.907672 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.907837 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.907981 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.908160 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.908297 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.908464 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.908684 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.908826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.909002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.909150 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.909337 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.909473 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.909638 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.909764 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.909938 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.910074 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.910239 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.910405 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.910568 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.910713 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.910860 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.911000 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.911164 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.911299 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.911507 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.911651 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.911819 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.911964 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.912127 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.912262 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.912430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.912574 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.912752 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.912898 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.913063 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.913200 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.913366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.913531 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.913679 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.913817 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.913959 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.914091 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.914256 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.914538 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.914678 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.914890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.915025 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.915198 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.915334 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.915510 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.915656 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.915835 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.915962 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.916154 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.916275 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.916460 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.916691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.917386 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.917904 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.918140 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.918285 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.918466 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.918602 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.918741 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.918875 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.919017 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.919160 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.919300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.919435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.919580 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.919720 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.919851 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.919992 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.920138 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.920274 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.920405 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.920527 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.920647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.920861 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.921009 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.921153 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.921286 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.921425 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.921568 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.921700 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.921839 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.921977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.922110 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.922240 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.922416 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.922560 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.922692 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.922823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.922955 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.923126 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.923271 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.923434 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.923574 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.923744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.923888 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.924051 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.924198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.924365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.924510 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.924704 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.924844 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.925023 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.925160 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.925338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.925477 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.925655 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.925793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.925961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.926103 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.926269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.926432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.926603 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.926741 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.926909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.927044 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.927214 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.927357 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.927522 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.927665 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.927844 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.927980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.928155 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.928298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.928461 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.928611 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.928803 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.928938 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.929119 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.929264 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.929484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.929660 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.929798 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.929995 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.930143 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.930317 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.930522 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.930665 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.930804 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.930996 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.931132 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.931305 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.931456 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.931704 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.931839 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.931971 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.932103 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.932234 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.932374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.933152 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.933332 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.933535 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.933735 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.933923 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.934120 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.934307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.937100 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.937215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.937304 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.937458 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.937594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.937734 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.937825 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.937961 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.938051 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.938140 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.938227 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.938313 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.938472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.938563 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.938655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.938757 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.938843 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.938934 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.939019 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.939153 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.939299 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.939433 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.939523 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.939608 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.939692 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.939824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.939928 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.940023 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.940157 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.940287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.940378 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.941154 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.941271 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.941367 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.941367 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.941585 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.941673 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.941765 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.941860 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.941947 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.942039 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.942133 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.942226 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.942325 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.942454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.942553 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.942640 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.942733 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.942826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.942921 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.943014 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.943099 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.943195 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.943289 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.943368 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.943470 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.943606 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.943729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.943870 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.944003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.944147 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.944279 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.944376 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.944462 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.944555 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.944641 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.944739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.944841 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.944928 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.945019 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.945104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.945195 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.945291 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.945403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.945499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.945732 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.945826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.946059 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.946163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.946385 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.946490 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.946700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.946863 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.947035 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.947172 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.947319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.947461 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.947626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.947764 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.947953 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.948118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.948457 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.948594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.948792 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.948994 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.949154 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.949298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.949442 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.949582 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.949723 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.949946 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.950088 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.950221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.950370 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.950517 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.950650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.950797 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.950939 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.951073 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.951236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.951373 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.951552 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.951703 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.951843 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.951976 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.952151 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.952287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.952456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.952598 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.952764 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.952900 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.953068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.953212 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.953376 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.953513 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.953683 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.953833 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.953988 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.954133 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.954279 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.954443 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.954635 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.954772 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.955003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.955137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.955321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.955459 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.955647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.955782 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.955962 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.956107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.956275 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.956413 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.956579 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.956716 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.956846 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 01:32:11.956996 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.957206 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.957522 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.957832 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.958165 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.958502 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.958816 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.959129 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.959440 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.959750 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.960060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.960390 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.960719 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.961025 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.961353 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.961675 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.961995 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.962310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.962645 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.962974 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.963286 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.963601 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.963948 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.964257 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.964568 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.964964 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.965238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.965551 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.965867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.966183 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.966538 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.971370 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.971370 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.971370 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.971370 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.971370 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.971370 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.971370 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.971370 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.972015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.972015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.972015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 03 01:32:11.972015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 03 01:32:12.018832 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO dbcounter [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] Registered counter for database nova_api Sep 03 01:32:12.033415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO dbcounter [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] Registered counter for database nova_api Sep 03 01:32:12.039924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_db.sqlalchemy.engines [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:32:12.047300 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writer thread running {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:32:12.053884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_db.sqlalchemy.engines [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:32:12.060634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writer thread running {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:32:12.103492 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.context [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6a8cb256-d368-4056-95f0-fbb32024e9fd(cell1) {{(pid=127553) load_cells /opt/stack/nova/nova/context.py:464}} Sep 03 01:32:12.108302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:32:12.108780 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:32:12.110370 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:32:12.111109 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:32:12.111562 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:32:12.113566 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:32:12.115592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO dbcounter [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] Registered counter for database nova_cell0 Sep 03 01:32:12.115881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.context [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),6a8cb256-d368-4056-95f0-fbb32024e9fd(cell1) {{(pid=127552) load_cells /opt/stack/nova/nova/context.py:464}} Sep 03 01:32:12.119700 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO dbcounter [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] Registered counter for database nova_cell1 Sep 03 01:32:12.119883 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:32:12.120383 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:32:12.121938 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:32:12.122704 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:32:12.123148 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:32:12.125161 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:32:12.126839 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_db.sqlalchemy.engines [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:32:12.127245 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO dbcounter [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] Registered counter for database nova_cell0 Sep 03 01:32:12.129077 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_db.sqlalchemy.engines [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:32:12.131342 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO dbcounter [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] Registered counter for database nova_cell1 Sep 03 01:32:12.134303 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writer thread running {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:32:12.137128 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writer thread running {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:32:12.140377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_db.sqlalchemy.engines [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:32:12.142687 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_db.sqlalchemy.engines [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:32:12.153784 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writer thread running {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:32:12.154051 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writer thread running {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:32:12.286511 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO dbcounter [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] Registered counter for database nova_cell0 Sep 03 01:32:12.294198 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_db.sqlalchemy.engines [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:32:12.299376 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writer thread running {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:32:12.303395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO dbcounter [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] Registered counter for database nova_cell0 Sep 03 01:32:12.310256 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_db.sqlalchemy.engines [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 03 01:32:12.314807 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writer thread running {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 03 01:32:12.626826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: WARNING keystonemiddleware.auth_token [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 01:32:12.634160 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: WARNING keystonemiddleware.auth_token [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 01:32:12.635907 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: WARNING keystonemiddleware.auth_token [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 01:32:12.643181 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: WARNING keystonemiddleware.auth_token [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 01:32:12.990139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: WARNING keystonemiddleware.auth_token [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 01:32:12.993512 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: WARNING keystonemiddleware.auth_token [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 03 01:32:12.998284 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: WARNING keystonemiddleware.auth_token [None req-137e6d86-5768-4e9a-880b-a3ef44b6cecd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 01:32:13.000911 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: WARNING keystonemiddleware.auth_token [None req-eb2d4faa-d862-4c45-8d70-a297a13c0395 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 03 01:32:13.003656 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f0fbc989c0 pid: 127553 (default app) Sep 03 01:32:13.005875 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f0fbc989c0 pid: 127552 (default app) Sep 03 01:32:50.756645 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=3 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:50.757692 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=3 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:50.759265 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=3 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:50.760352 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=3 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:51.849052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9d93fabc-8d45-4317-a82f-cc63b91aac5e tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Action: 'create', calling method: .version_select at 0x7f6d258c3280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2053289093"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:32:53.918864 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9d93fabc-8d45-4317-a82f-cc63b91aac5e tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.176082 Sep 03 01:32:53.929492 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Sep 3 01:32:50 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3179 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 03 01:32:53.936527 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=3 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:53.937326 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=3 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:53.938218 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=3 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:53.941269 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=3 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:32:54.270903 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-459a2934-17b7-4ac3-83ea-2a2153f799d1 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d2597fe50>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:32:54.962689 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-459a2934-17b7-4ac3-83ea-2a2153f799d1 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144" status: 200 len: 345 microversion: 2.1 time: 1.031334 Sep 03 01:32:54.964280 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 1/2] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:32:53 2022] GET /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144 => generated 345 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:32:55.983302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ccd4f890-ded0-4896-9e16-304a8dca0f9a tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d257a4160>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:32:56.037854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ccd4f890-ded0-4896-9e16-304a8dca0f9a tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144" status: 200 len: 346 microversion: 2.1 time: 0.063123 Sep 03 01:32:56.039871 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:32:55 2022] GET /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144 => generated 346 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:32:56.054841 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b592c796-bb57-46f2-85f0-aa2e47668845 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Action: 'create', calling method: .version_select at 0x7f6d25783160>, body: {"snapshot": {"volume_id": "8232c2b9-7502-4ce8-9825-4de3aa343144", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2063233328"}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:32:56.984024 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b592c796-bb57-46f2-85f0-aa2e47668845 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.932991 Sep 03 01:32:56.996277 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 2/4] 10.222.0.13 () {60 vars in 1162 bytes} [Sat Sep 3 01:32:56 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:32:56.998566 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-746d5216-5733-48e9-a6c7-8611ce8dba51 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d257a4820>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:32:57.190968 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-746d5216-5733-48e9-a6c7-8611ce8dba51 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092" status: 200 len: 287 microversion: 2.1 time: 0.198216 Sep 03 01:32:57.192156 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 3/5] 10.222.0.13 () {58 vars in 1251 bytes} [Sat Sep 3 01:32:56 2022] GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092 => generated 287 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:32:57.206827 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-84377b30-a39d-4058-9b75-6e19e35beac1 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d25783280>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:32:57.298373 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-84377b30-a39d-4058-9b75-6e19e35beac1 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.096704 Sep 03 01:32:57.310187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 3/6] 10.222.0.13 () {58 vars in 1140 bytes} [Sat Sep 3 01:32:57 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:32:57.312478 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-825fa2e3-cb64-4137-84de-dd34359e8463 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d257a4f70>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:32:57.372115 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-825fa2e3-cb64-4137-84de-dd34359e8463 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092" status: 200 len: 287 microversion: 2.1 time: 0.063489 Sep 03 01:32:57.378634 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1251 bytes} [Sat Sep 3 01:32:57 2022] GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:32:58.388191 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-11c2a9b0-4c62-490d-b581-81642fb29167 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d2572b3a0>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:32:58.463875 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-11c2a9b0-4c62-490d-b581-81642fb29167 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092" status: 200 len: 287 microversion: 2.1 time: 0.081545 Sep 03 01:32:58.464621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1251 bytes} [Sat Sep 3 01:32:58 2022] GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:32:59.479284 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-66c1c4b6-822b-459c-a007-841a224f02a1 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d257a4af0>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:32:59.571833 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-66c1c4b6-822b-459c-a007-841a224f02a1 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092" status: 200 len: 287 microversion: 2.1 time: 0.097414 Sep 03 01:32:59.577854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 5/9] 10.222.0.13 () {58 vars in 1251 bytes} [Sat Sep 3 01:32:59 2022] GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092 => generated 287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:00.587609 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-db78787f-05cb-4d8c-a9ea-e676eb27d920 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d257a4820>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:00.649481 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-db78787f-05cb-4d8c-a9ea-e676eb27d920 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092" status: 200 len: 287 microversion: 2.1 time: 0.067359 Sep 03 01:33:00.650058 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 5/10] 10.222.0.13 () {58 vars in 1251 bytes} [Sat Sep 3 01:33:00 2022] GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:01.662159 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-57ee6aa3-fcf1-4ff3-b581-eb959a2f5036 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d257a4430>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:01.722724 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-57ee6aa3-fcf1-4ff3-b581-eb959a2f5036 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092" status: 200 len: 288 microversion: 2.1 time: 0.064310 Sep 03 01:33:01.728872 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 6/11] 10.222.0.13 () {58 vars in 1251 bytes} [Sat Sep 3 01:33:01 2022] GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092 => generated 288 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:01.740147 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2817ff27-1a2c-4f5a-8ec9-e8a2afd1efc9 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d257a4040>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:01.955265 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2817ff27-1a2c-4f5a-8ec9-e8a2afd1efc9 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092" status: 202 len: 0 microversion: 2.1 time: 0.218814 Sep 03 01:33:01.955835 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 6/12] 10.222.0.13 () {58 vars in 1254 bytes} [Sat Sep 3 01:33:01 2022] DELETE /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092 => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:33:01.965945 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b387be86-ba82-46a6-9585-a57db1705277 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d25732040>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:02.023361 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b387be86-ba82-46a6-9585-a57db1705277 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092" status: 200 len: 287 microversion: 2.1 time: 0.062582 Sep 03 01:33:02.029126 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 7/13] 10.222.0.13 () {58 vars in 1251 bytes} [Sat Sep 3 01:33:01 2022] GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:03.037557 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c5d24def-70e4-46be-b691-83adfa3ee6d1 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d260f2310>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:03.085559 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-c5d24def-70e4-46be-b691-83adfa3ee6d1 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] HTTP exception thrown: Snapshot d356e06b-7f0a-47fb-8dad-6712ba876092 could not be found. Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c5d24def-70e4-46be-b691-83adfa3ee6d1 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Request method failure captured: Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092 HTTP/1.1 Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7C6TOgQ-EVhfbeNdmsutNNTMdJFiQQxmF1HI5Ng_YyIXC8gyFX_5xi5r8XzppMNeK_tL-6DeqMikMpCK1aew_y1L37I18sVgslP7Uwp1n0IMNFMQheGz1_ebBNrTF0g8SQihzG5ssafYv3AIVCk72bfHkbPqh7iPsFMxbIjgfsehg Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 46cc32edc42d42399a330991d62f4682 Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1276542892 Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:33:03.091187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:33:03.092670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_46cc32edc42d42399a330991d62f4682"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/46cc32edc42d42399a330991d62f4682"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/46cc32edc42d42399a330991d62f4682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/46cc32edc42d42399a330991d62f4682"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:33:03.092670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1276542892 Sep 03 01:33:03.092670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 46cc32edc42d42399a330991d62f4682 Sep 03 01:33:03.092670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1276542892 Sep 03 01:33:03.092670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-VolumesSnapshotsTestJSON-1276542892-project Sep 03 01:33:03.092670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:33:03.092670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:33:03.092670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: c5bef358e02645d98ef923c8e131d80b Sep 03 01:33:03.092670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1276542892-project Sep 03 01:33:03.092670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: Sep 03 01:33:03.092670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Snapshot d356e06b-7f0a-47fb-8dad-6712ba876092 could not be found. Sep 03 01:33:03.092670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': 'd356e06b-7f0a-47fb-8dad-6712ba876092'} Sep 03 01:33:03.092670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d356e06b-7f0a-47fb-8dad-6712ba876092 could not be found. (HTTP 404) (Request-ID: req-8fdcf097-5151-47f4-abfa-5f6794b9e711) Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:33:03.093594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 01:33:03.094504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d356e06b-7f0a-47fb-8dad-6712ba876092 could not be found. Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 03 01:33:03.097029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:33:03.098201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d356e06b-7f0a-47fb-8dad-6712ba876092 could not be found. Sep 03 01:33:03.098201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:33:03.098201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:33:03.098201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:33:03.098201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:03.098201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:33:03.098201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:33:03.098201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:33:03.098201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:33:03.098201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d356e06b-7f0a-47fb-8dad-6712ba876092 could not be found. Sep 03 01:33:03.098201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:33:03.098201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c5d24def-70e4-46be-b691-83adfa3ee6d1 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Returning 404 to user: Snapshot d356e06b-7f0a-47fb-8dad-6712ba876092 could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:33:03.098201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c5d24def-70e4-46be-b691-83adfa3ee6d1 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092" status: 404 len: 111 microversion: 2.1 time: 0.059480 Sep 03 01:33:03.099368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 7/14] 10.222.0.13 () {58 vars in 1251 bytes} [Sat Sep 3 01:33:03 2022] GET /compute/v2.1/os-snapshots/d356e06b-7f0a-47fb-8dad-6712ba876092 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:33:03.105847 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9e880bef-a764-4ef9-b17e-7b1aaebc7da3 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d25732700>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:03.473810 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9e880bef-a764-4ef9-b17e-7b1aaebc7da3 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144" status: 202 len: 0 microversion: 2.1 time: 0.372646 Sep 03 01:33:03.478072 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 8/15] 10.222.0.13 () {58 vars in 1248 bytes} [Sat Sep 3 01:33:03 2022] DELETE /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144 => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:33:03.497156 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3c5d8ab6-99e2-4a53-bc78-68970531a532 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d25783790>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:03.614136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3c5d8ab6-99e2-4a53-bc78-68970531a532 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144" status: 200 len: 345 microversion: 2.1 time: 0.133821 Sep 03 01:33:03.622540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 8/16] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:33:03 2022] GET /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144 => generated 345 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:04.631887 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d04e7504-69f2-45dc-b518-3e5f3528e238 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d257a43a0>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:04.685109 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-d04e7504-69f2-45dc-b518-3e5f3528e238 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] HTTP exception thrown: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d04e7504-69f2-45dc-b518-3e5f3528e238 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Request method failure captured: Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144 HTTP/1.1 Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7C6TOgQ-EVhfbeNdmsutNNTMdJFiQQxmF1HI5Ng_YyIXC8gyFX_5xi5r8XzppMNeK_tL-6DeqMikMpCK1aew_y1L37I18sVgslP7Uwp1n0IMNFMQheGz1_ebBNrTF0g8SQihzG5ssafYv3AIVCk72bfHkbPqh7iPsFMxbIjgfsehg Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 46cc32edc42d42399a330991d62f4682 Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1276542892 Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:33:04.689454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:33:04.690595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_46cc32edc42d42399a330991d62f4682"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/46cc32edc42d42399a330991d62f4682"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/46cc32edc42d42399a330991d62f4682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/46cc32edc42d42399a330991d62f4682"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:33:04.690595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1276542892 Sep 03 01:33:04.690595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 46cc32edc42d42399a330991d62f4682 Sep 03 01:33:04.690595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1276542892 Sep 03 01:33:04.690595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-VolumesSnapshotsTestJSON-1276542892-project Sep 03 01:33:04.690595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:33:04.690595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:33:04.690595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: c5bef358e02645d98ef923c8e131d80b Sep 03 01:33:04.690595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1276542892-project Sep 03 01:33:04.690595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: Sep 03 01:33:04.690595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.690595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '8232c2b9-7502-4ce8-9825-4de3aa343144'} Sep 03 01:33:04.690595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. (HTTP 404) (Request-ID: req-481c3715-499d-4c1c-9bfd-fee8a56d39f0) Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:33:04.691306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 01:33:04.692193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 03 01:33:04.693067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:33:04.693924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.693924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.693924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:33:04.693924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.693924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:04.693924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:33:04.693924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:33:04.693924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:33:04.693924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:33:04.693924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.693924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.717754 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d04e7504-69f2-45dc-b518-3e5f3528e238 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Returning 404 to user: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:33:04.723061 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d04e7504-69f2-45dc-b518-3e5f3528e238 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144" status: 404 len: 109 microversion: 2.1 time: 0.095091 Sep 03 01:33:04.742068 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 9/17] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:33:04 2022] GET /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144 => generated 109 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:33:04.773398 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c1b66f13-7153-4f52-b5d7-5537fe814ce7 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d260f28b0>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:04.886035 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-c1b66f13-7153-4f52-b5d7-5537fe814ce7 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] HTTP exception thrown: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c1b66f13-7153-4f52-b5d7-5537fe814ce7 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Request method failure captured: Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: DELETE /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144 HTTP/1.1 Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7C6TOgQ-EVhfbeNdmsutNNTMdJFiQQxmF1HI5Ng_YyIXC8gyFX_5xi5r8XzppMNeK_tL-6DeqMikMpCK1aew_y1L37I18sVgslP7Uwp1n0IMNFMQheGz1_ebBNrTF0g8SQihzG5ssafYv3AIVCk72bfHkbPqh7iPsFMxbIjgfsehg Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 46cc32edc42d42399a330991d62f4682 Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1276542892 Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:33:04.888516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:33:04.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_46cc32edc42d42399a330991d62f4682"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/46cc32edc42d42399a330991d62f4682"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/46cc32edc42d42399a330991d62f4682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/46cc32edc42d42399a330991d62f4682"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:33:04.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1276542892 Sep 03 01:33:04.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 46cc32edc42d42399a330991d62f4682 Sep 03 01:33:04.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1276542892 Sep 03 01:33:04.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-VolumesSnapshotsTestJSON-1276542892-project Sep 03 01:33:04.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:33:04.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:33:04.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: c5bef358e02645d98ef923c8e131d80b Sep 03 01:33:04.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1276542892-project Sep 03 01:33:04.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: Sep 03 01:33:04.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '8232c2b9-7502-4ce8-9825-4de3aa343144'} Sep 03 01:33:04.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. (HTTP 404) (Request-ID: req-2d22d582-78c5-4432-b6a8-02163cb74543) Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:33:04.890326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 01:33:04.891229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 03 01:33:04.892958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:33:04.894937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.894937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.894937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:33:04.894937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.894937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:04.894937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:33:04.894937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:33:04.894937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:33:04.894937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:33:04.894937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.894937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.894937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c1b66f13-7153-4f52-b5d7-5537fe814ce7 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Returning 404 to user: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:33:04.894937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c1b66f13-7153-4f52-b5d7-5537fe814ce7 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144" status: 404 len: 109 microversion: 2.1 time: 0.144728 Sep 03 01:33:04.896307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 10/18] 10.222.0.13 () {58 vars in 1248 bytes} [Sat Sep 3 01:33:04 2022] DELETE /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144 => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:33:04.909997 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-14011414-3991-4814-a835-86e2aceb4db2 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Calling method '.version_select at 0x7f6d25732ee0>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:04.981907 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-14011414-3991-4814-a835-86e2aceb4db2 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] HTTP exception thrown: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-14011414-3991-4814-a835-86e2aceb4db2 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Request method failure captured: Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144 HTTP/1.1 Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7C6TOgQ-EVhfbeNdmsutNNTMdJFiQQxmF1HI5Ng_YyIXC8gyFX_5xi5r8XzppMNeK_tL-6DeqMikMpCK1aew_y1L37I18sVgslP7Uwp1n0IMNFMQheGz1_ebBNrTF0g8SQihzG5ssafYv3AIVCk72bfHkbPqh7iPsFMxbIjgfsehg Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 46cc32edc42d42399a330991d62f4682 Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1276542892 Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:33:04.984052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:33:04.985074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_46cc32edc42d42399a330991d62f4682"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/46cc32edc42d42399a330991d62f4682"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/46cc32edc42d42399a330991d62f4682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/46cc32edc42d42399a330991d62f4682"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:33:04.985074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1276542892 Sep 03 01:33:04.985074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 46cc32edc42d42399a330991d62f4682 Sep 03 01:33:04.985074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1276542892 Sep 03 01:33:04.985074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-VolumesSnapshotsTestJSON-1276542892-project Sep 03 01:33:04.985074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:33:04.985074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:33:04.985074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: c5bef358e02645d98ef923c8e131d80b Sep 03 01:33:04.985074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1276542892-project Sep 03 01:33:04.985074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: Sep 03 01:33:04.985074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.985074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '8232c2b9-7502-4ce8-9825-4de3aa343144'} Sep 03 01:33:04.985074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. (HTTP 404) (Request-ID: req-3da0eda8-6a2a-4eec-8bcb-46e30f8dc5a2) Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:33:04.985687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 01:33:04.987417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 03 01:33:04.988931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-14011414-3991-4814-a835-86e2aceb4db2 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] Returning 404 to user: Volume 8232c2b9-7502-4ce8-9825-4de3aa343144 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-14011414-3991-4814-a835-86e2aceb4db2 tempest-VolumesSnapshotsTestJSON-1276542892 tempest-VolumesSnapshotsTestJSON-1276542892-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144" status: 404 len: 109 microversion: 2.1 time: 0.090905 Sep 03 01:33:04.991466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 11/19] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:33:04 2022] GET /compute/v2.1/os-volumes/8232c2b9-7502-4ce8-9825-4de3aa343144 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:33:05.414172 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-417538639", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "networks": [{"uuid": "e76c3328-9980-42be-a38f-bf4c2c60f920"}]}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:05.671311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.network.neutron [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] validate_networks() for [('e76c3328-9980-42be-a38f-bf4c2c60f920', None, None, None, None, None)] {{(pid=127552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:33:08.950780 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b1fa8c0e-e905-4b83-94c3-0620fcd88501 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Action: 'create', calling method: .version_select at 0x7f6d257a40d0>, body: {"keypair": {"name": "tempest-keypair-1948356925", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9clPPJ6NQzqz2GU4AwuskVRQqlHK+vBuv2M4E01WEyDe9PXZ6DV2weDpMjovWoYGW7LtFJgWT2yzxvYWitpu9qsIssGfD4rSyFlf1Z9lE6sTc054atOx3D8ZbjVIoPtg=="}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:09.093462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-b1fa8c0e-e905-4b83-94c3-0620fcd88501 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Getting quotas for project e09bed4b9f9741a8ab110a2676baee7f. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:33:09.116548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-b1fa8c0e-e905-4b83-94c3-0620fcd88501 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Getting quotas for user 29b4f0836bbf4684bdc6177e42b88b20 and project e09bed4b9f9741a8ab110a2676baee7f. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:33:09.285441 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b1fa8c0e-e905-4b83-94c3-0620fcd88501 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.144078 Sep 03 01:33:09.287057 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 12/20] 10.222.0.13 () {62 vars in 1200 bytes} [Sat Sep 3 01:33:08 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1147 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Sep 03 01:33:09.792961 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6be6f3dd-6260-4b40-9786-6220c04a08f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Action: 'create', calling method: .version_select at 0x7f6d2566c040>, body: {"keypair": {"name": "tempest-keypair-1118907697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMQFQMTTqNoR7iQjUUXTQYEUv1ZaSXYr19d6LKaVQqm+Oqyv7uvEKXE9JvrEodDgjbv7ieWl5MrU+v+EA4eIzjxLeG5ufhkpv8kgdlaVb00RuWZpyJnM2lUsVNH+B2fC0A=="}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:09.844843 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-6be6f3dd-6260-4b40-9786-6220c04a08f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for project 02813cf0683749ee87b039b28f1aeebb. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:33:09.861225 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-6be6f3dd-6260-4b40-9786-6220c04a08f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for user 2b9ab1983bb84318b509878b930e9402 and project 02813cf0683749ee87b039b28f1aeebb. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:33:10.002773 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6be6f3dd-6260-4b40-9786-6220c04a08f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.713403 Sep 03 01:33:10.016703 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 13/21] 10.222.0.13 () {60 vars in 1159 bytes} [Sat Sep 3 01:33:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:10.018967 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Flavor limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:33:10.019462 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Image limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:33:10.019860 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Flavor pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:33:10.020269 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Image pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:33:10.020682 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:33:10.079202 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:10.085611 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:10.085611 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:10.085611 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:10.085611 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:10.086004 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:10.155318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Getting quotas for project c0a44ea5393c4fb58fce35e8cbc4103b. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:33:10.163039 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Getting quotas for user d73c9c5108a845fdbd25b67bcb3a00f4 and project c0a44ea5393c4fb58fce35e8cbc4103b. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:33:10.182713 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Going to run 1 instances... {{(pid=127552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:33:10.191906 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:33:10.410181 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a76692fd-0fc4-4156-94e6-a7845cb2c360 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.678337 Sep 03 01:33:10.419188 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 9/22] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:33:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 5688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:33:10.501509 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1216048294", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:10.592792 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-65833590-05f2-4af3-bb3a-ebf18f6b3ec1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Action: 'create', calling method: .version_select at 0x7f6d24e01e50>, body: {"keypair": {"name": "tempest-keypair-1438646856", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPoBAXriS72KVmcU8TgG/y8MpiBa9zpfn8ImGitQxpRhChqUC5vTH6lPbVP2QRWQoaSlQ0aylvDkb8kpEWvkTpph2XDfUjztLkgCJjuyiLE9lEwatABwz50i+r2SKYbkFw=="}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:10.671721 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.network.neutron [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] validate_networks() for [('df7b7060-2be9-45b6-8d4b-e4a77085b457', None, None, None, None, None)] {{(pid=127553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:33:10.679658 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-65833590-05f2-4af3-bb3a-ebf18f6b3ec1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Getting quotas for project 53cde5b369084772897d46c38b083d8f. Resources: {'key_pairs'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:33:10.692199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-65833590-05f2-4af3-bb3a-ebf18f6b3ec1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Getting quotas for user ecf076dde874415aa734644f27a10b4b and project 53cde5b369084772897d46c38b083d8f. Resources: {'key_pairs'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:33:10.835681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-65833590-05f2-4af3-bb3a-ebf18f6b3ec1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.415059 Sep 03 01:33:10.839196 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 10/23] 10.222.0.13 () {60 vars in 1159 bytes} [Sat Sep 3 01:33:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:10.855958 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-43aa0df2-2fa5-4833-ae68-362cf89b4879 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:10.857061 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-43aa0df2-2fa5-4833-ae68-362cf89b4879 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:11.141713 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-43aa0df2-2fa5-4833-ae68-362cf89b4879 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:11.179250 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-43aa0df2-2fa5-4833-ae68-362cf89b4879 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1214 microversion: 2.1 time: 0.331240 Sep 03 01:33:11.183110 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 11/24] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:10 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1214 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:12.205796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a19bd320-55a8-4123-a28f-9e962c0bb623 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:12.216228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a19bd320-55a8-4123-a28f-9e962c0bb623 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:12.603918 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a19bd320-55a8-4123-a28f-9e962c0bb623 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:12.617185 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a19bd320-55a8-4123-a28f-9e962c0bb623 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1214 microversion: 2.1 time: 0.415842 Sep 03 01:33:12.621330 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 12/25] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:12 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1214 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:13.648198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e6144394-7876-4e89-9f66-052f24151b1d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:13.651683 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e6144394-7876-4e89-9f66-052f24151b1d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:13.665337 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6144394-7876-4e89-9f66-052f24151b1d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:13.666081 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6144394-7876-4e89-9f66-052f24151b1d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:13.668489 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6144394-7876-4e89-9f66-052f24151b1d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:13.670267 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6144394-7876-4e89-9f66-052f24151b1d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:13.671357 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6144394-7876-4e89-9f66-052f24151b1d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:13.673428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6144394-7876-4e89-9f66-052f24151b1d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:14.078320 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e6144394-7876-4e89-9f66-052f24151b1d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:14.095187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e6144394-7876-4e89-9f66-052f24151b1d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1218 microversion: 2.1 time: 0.451569 Sep 03 01:33:14.110963 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 13/26] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:13 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1218 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:14.261347 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Flavor limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:33:14.261824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Image limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:33:14.262804 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Flavor pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:33:14.263945 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Image pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:33:14.265219 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:33:14.277411 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:14.278857 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:14.279830 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:14.281044 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:14.281574 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:14.282193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:14.319301 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Getting quotas for project d93c5a3ef20c4a5b87af4803f820b60e. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:33:14.326246 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Getting quotas for user 409c324dca974d9dad9529b2a0d82b30 and project d93c5a3ef20c4a5b87af4803f820b60e. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:33:14.394117 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Going to run 1 instances... {{(pid=127553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:33:14.410626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:33:14.700395 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9d89a60d-cb7e-4a73-9cca-6e30637599ad tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.514824 Sep 03 01:33:14.704024 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 14/27] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:33:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 4523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 01:33:14.721544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-dd5384ab-e225-491a-9cea-f24c0d0b8339 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:14.723232 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-dd5384ab-e225-491a-9cea-f24c0d0b8339 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:14.885196 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dd5384ab-e225-491a-9cea-f24c0d0b8339 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:14.892557 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-dd5384ab-e225-491a-9cea-f24c0d0b8339 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1222 microversion: 2.1 time: 0.177706 Sep 03 01:33:14.923953 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 14/28] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:14 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1222 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:15.122450 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-404b6f3e-e9fa-41bf-abc3-e4cecf2019e9 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:15.124114 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-404b6f3e-e9fa-41bf-abc3-e4cecf2019e9 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:15.188926 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-404b6f3e-e9fa-41bf-abc3-e4cecf2019e9 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:15.191153 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-404b6f3e-e9fa-41bf-abc3-e4cecf2019e9 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:15.191153 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-404b6f3e-e9fa-41bf-abc3-e4cecf2019e9 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:15.191153 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-404b6f3e-e9fa-41bf-abc3-e4cecf2019e9 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:15.197047 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-404b6f3e-e9fa-41bf-abc3-e4cecf2019e9 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:15.200250 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-404b6f3e-e9fa-41bf-abc3-e4cecf2019e9 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:15.338128 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2095225894", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:15.474236 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.network.neutron [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] validate_networks() for [('df7b7060-2be9-45b6-8d4b-e4a77085b457', None, None, None, None, None)] {{(pid=127552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:33:15.816413 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-404b6f3e-e9fa-41bf-abc3-e4cecf2019e9 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:15.892291 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-404b6f3e-e9fa-41bf-abc3-e4cecf2019e9 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1266 microversion: 2.1 time: 0.776061 Sep 03 01:33:15.892923 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 15/29] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:15 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1266 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:16.260472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Flavor limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:33:16.260472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Image limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:33:16.260472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Flavor pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:33:16.260472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Image pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:33:16.260472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:33:16.277743 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:16.278240 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:16.278711 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:16.279448 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:16.312348 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:16.314201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:16.397983 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Getting quotas for project d93c5a3ef20c4a5b87af4803f820b60e. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:33:16.410573 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Getting quotas for user 409c324dca974d9dad9529b2a0d82b30 and project d93c5a3ef20c4a5b87af4803f820b60e. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:33:16.444219 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Going to run 1 instances... {{(pid=127552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:33:16.456968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:33:16.625541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0976722b-7d49-46d9-b37a-9da7b4811c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.292295 Sep 03 01:33:16.627504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 15/30] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:33:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 1295 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 01:33:16.643640 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8136521c-89d1-422c-8084-f15bf20a0fc4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:16.644600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8136521c-89d1-422c-8084-f15bf20a0fc4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:16.880437 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-578526746", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9f4d104-d756-4b2b-9b1c-81ea8775b5d5"}], "security_groups": [{"name": "tempest-securitygroup--1852699591"}], "key_name": "tempest-keypair-1948356925", "user_data": "}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:17.147207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.network.neutron [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] validate_networks() for [('b9f4d104-d756-4b2b-9b1c-81ea8775b5d5', None, None, None, None, None)] {{(pid=127552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:33:17.154762 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8136521c-89d1-422c-8084-f15bf20a0fc4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:17.188938 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8136521c-89d1-422c-8084-f15bf20a0fc4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1222 microversion: 2.1 time: 0.546418 Sep 03 01:33:17.190719 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 16/31] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:16 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1222 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:17.222583 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-eed3aa72-74dd-480c-9670-cdc1be18d9a6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:17.227292 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-eed3aa72-74dd-480c-9670-cdc1be18d9a6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:17.281832 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eed3aa72-74dd-480c-9670-cdc1be18d9a6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:17.285145 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eed3aa72-74dd-480c-9670-cdc1be18d9a6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:17.287065 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eed3aa72-74dd-480c-9670-cdc1be18d9a6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:17.287821 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eed3aa72-74dd-480c-9670-cdc1be18d9a6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:17.288293 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eed3aa72-74dd-480c-9670-cdc1be18d9a6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:17.288731 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eed3aa72-74dd-480c-9670-cdc1be18d9a6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:17.694037 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-eed3aa72-74dd-480c-9670-cdc1be18d9a6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:17.705272 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-eed3aa72-74dd-480c-9670-cdc1be18d9a6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1272 microversion: 2.1 time: 0.513400 Sep 03 01:33:17.719282 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 17/32] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:17 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1272 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:17.729385 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-323481853", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7bd92e7f-f880-47a6-a573-413ea7d8bd54"}], "security_groups": [{"name": "tempest-securitygroup--1501834642"}], "key_name": "tempest-keypair-1118907697", "user_data": "}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:18.327503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.network.neutron [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] validate_networks() for [('7bd92e7f-f880-47a6-a573-413ea7d8bd54', None, None, None, None, None)] {{(pid=127553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:33:18.561961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Flavor limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:33:18.562851 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Image limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:33:18.562986 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Flavor pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:33:18.563372 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Image pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:33:18.563794 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:33:18.586726 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:18.587326 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:18.587834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:18.588580 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:18.589113 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:18.589593 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:18.636016 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Getting quotas for project e09bed4b9f9741a8ab110a2676baee7f. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:33:18.651377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Getting quotas for user 29b4f0836bbf4684bdc6177e42b88b20 and project e09bed4b9f9741a8ab110a2676baee7f. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:33:18.731897 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Going to run 1 instances... {{(pid=127552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:33:18.737464 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:33:19.008796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-49115760-eebf-4af2-bfa6-216af171fd21 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.133047 Sep 03 01:33:19.010207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 16/33] 10.222.0.13 () {62 vars in 1188 bytes} [Sat Sep 3 01:33:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 2135 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 03 01:33:19.042452 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-fd429930-631f-477f-9b98-0c4be255fddb tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:19.043121 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-fd429930-631f-477f-9b98-0c4be255fddb tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:19.067647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fd429930-631f-477f-9b98-0c4be255fddb tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:19.068242 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fd429930-631f-477f-9b98-0c4be255fddb tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:19.068898 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fd429930-631f-477f-9b98-0c4be255fddb tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:19.069616 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fd429930-631f-477f-9b98-0c4be255fddb tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:19.070083 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fd429930-631f-477f-9b98-0c4be255fddb tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:19.070708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fd429930-631f-477f-9b98-0c4be255fddb tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:19.356974 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-fd429930-631f-477f-9b98-0c4be255fddb tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:19.366211 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-fd429930-631f-477f-9b98-0c4be255fddb tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1226 microversion: 2.1 time: 0.354709 Sep 03 01:33:19.374642 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 17/34] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:19 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1226 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:19.385297 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-76a822bf-de21-44b9-b0d1-5164a8ac1154 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:19.394482 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-76a822bf-de21-44b9-b0d1-5164a8ac1154 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:19.422224 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76a822bf-de21-44b9-b0d1-5164a8ac1154 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:19.422910 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76a822bf-de21-44b9-b0d1-5164a8ac1154 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:19.423297 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76a822bf-de21-44b9-b0d1-5164a8ac1154 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:19.424051 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76a822bf-de21-44b9-b0d1-5164a8ac1154 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:19.424510 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76a822bf-de21-44b9-b0d1-5164a8ac1154 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:19.424943 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76a822bf-de21-44b9-b0d1-5164a8ac1154 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:20.036434 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-76a822bf-de21-44b9-b0d1-5164a8ac1154 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:20.036434 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-76a822bf-de21-44b9-b0d1-5164a8ac1154 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.475500 Sep 03 01:33:20.036434 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 18/35] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:19 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:20.037770 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1679726172", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3699488b-c45e-45e8-a057-bbc9d098a735"}], "security_groups": [{"name": "tempest-securitygroup--581545087"}], "key_name": "tempest-keypair-1438646856", "user_data": "}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:20.038064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Flavor limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:33:20.038064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Image limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:33:20.038064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Flavor pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:33:20.038064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Image pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:33:20.038064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:33:20.038922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:20.038922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:20.038922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:20.038922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:20.039866 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:20.039866 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:20.039866 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for project 02813cf0683749ee87b039b28f1aeebb. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:33:20.039866 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for user 2b9ab1983bb84318b509878b930e9402 and project 02813cf0683749ee87b039b28f1aeebb. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:33:20.040389 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Going to run 1 instances... {{(pid=127553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:33:20.040896 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:33:20.046740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.network.neutron [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] validate_networks() for [('3699488b-c45e-45e8-a057-bbc9d098a735', None, None, None, None, None)] {{(pid=127552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:33:20.500102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a16b43a6-c77d-49aa-b99b-20c7f4b49179 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.777817 Sep 03 01:33:20.503310 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 18/36] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:33:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 2783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:33:20.525154 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9cecb06b-df00-49e9-96f8-c8e5103c7cb3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:20.527825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9cecb06b-df00-49e9-96f8-c8e5103c7cb3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:20.651695 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9cecb06b-df00-49e9-96f8-c8e5103c7cb3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:20.685618 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9cecb06b-df00-49e9-96f8-c8e5103c7cb3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:20.688376 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9cecb06b-df00-49e9-96f8-c8e5103c7cb3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:20.693697 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9cecb06b-df00-49e9-96f8-c8e5103c7cb3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1281 microversion: 2.20 time: 0.186076 Sep 03 01:33:20.698534 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:20 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1281 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:20.720540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5a477072-afe7-4137-a545-46f728fbd000 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:20.721816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5a477072-afe7-4137-a545-46f728fbd000 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:20.740891 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a477072-afe7-4137-a545-46f728fbd000 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:20.741399 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a477072-afe7-4137-a545-46f728fbd000 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:20.741833 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a477072-afe7-4137-a545-46f728fbd000 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:20.745702 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a477072-afe7-4137-a545-46f728fbd000 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:20.746188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a477072-afe7-4137-a545-46f728fbd000 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:20.746642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a477072-afe7-4137-a545-46f728fbd000 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:20.916392 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Flavor limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:33:20.917124 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Image limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:33:20.917835 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Flavor pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:33:20.918480 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Image pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:33:20.920430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:33:20.940007 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:20.940936 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:20.944021 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:20.945178 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:20.948168 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:20.948892 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:20.985832 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5a477072-afe7-4137-a545-46f728fbd000 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:21.012324 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5a477072-afe7-4137-a545-46f728fbd000 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1274 microversion: 2.1 time: 0.312709 Sep 03 01:33:21.013770 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Getting quotas for project 53cde5b369084772897d46c38b083d8f. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:33:21.015526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 20/38] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:20 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1274 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:21.039626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-20c554ff-d9f9-4aaa-9a08-b8d7a4a0c4e9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:21.041875 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Getting quotas for user ecf076dde874415aa734644f27a10b4b and project 53cde5b369084772897d46c38b083d8f. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:33:21.043205 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-20c554ff-d9f9-4aaa-9a08-b8d7a4a0c4e9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:21.067265 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Going to run 1 instances... {{(pid=127552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:33:21.079218 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:33:21.264666 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-20c554ff-d9f9-4aaa-9a08-b8d7a4a0c4e9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:21.273868 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-20c554ff-d9f9-4aaa-9a08-b8d7a4a0c4e9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1241 microversion: 2.1 time: 0.256324 Sep 03 01:33:21.296814 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 21/39] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:21 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1241 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:21.313093 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-57fcbb8d-c474-4059-8832-86756de237f6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:21.314609 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-57fcbb8d-c474-4059-8832-86756de237f6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:21.347293 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57fcbb8d-c474-4059-8832-86756de237f6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:21.354909 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57fcbb8d-c474-4059-8832-86756de237f6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:21.355804 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57fcbb8d-c474-4059-8832-86756de237f6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:21.366665 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57fcbb8d-c474-4059-8832-86756de237f6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:21.367520 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57fcbb8d-c474-4059-8832-86756de237f6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:21.368377 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57fcbb8d-c474-4059-8832-86756de237f6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:21.375248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5364c5a6-671c-4fc9-962f-32109f7cc3fc tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.515865 Sep 03 01:33:21.379292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 19/40] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:33:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:33:21.392286 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ffa497ec-e089-4ff1-99ee-2691454e85c3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:21.399285 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ffa497ec-e089-4ff1-99ee-2691454e85c3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:21.421518 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:21.657743 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ffa497ec-e089-4ff1-99ee-2691454e85c3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:21.672588 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ffa497ec-e089-4ff1-99ee-2691454e85c3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1238 microversion: 2.1 time: 0.284240 Sep 03 01:33:21.673941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 20/41] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:21 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1238 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:21.734244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ae9fbde1-fee1-45dd-ad2c-9cb009ff070a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:21.738925 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ae9fbde1-fee1-45dd-ad2c-9cb009ff070a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:22.138633 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ae9fbde1-fee1-45dd-ad2c-9cb009ff070a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:22.152929 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ae9fbde1-fee1-45dd-ad2c-9cb009ff070a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:22.158206 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ae9fbde1-fee1-45dd-ad2c-9cb009ff070a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:22.166411 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ae9fbde1-fee1-45dd-ad2c-9cb009ff070a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1281 microversion: 2.20 time: 0.443604 Sep 03 01:33:22.168686 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 21/42] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:21 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1281 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:22.204277 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9d8053b1-548b-4b90-b580-90e71de9837a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:22.205873 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9d8053b1-548b-4b90-b580-90e71de9837a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:22.260530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9d8053b1-548b-4b90-b580-90e71de9837a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:22.261042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9d8053b1-548b-4b90-b580-90e71de9837a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:22.261495 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9d8053b1-548b-4b90-b580-90e71de9837a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:22.262221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9d8053b1-548b-4b90-b580-90e71de9837a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:22.262767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9d8053b1-548b-4b90-b580-90e71de9837a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:22.263203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9d8053b1-548b-4b90-b580-90e71de9837a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:22.321778 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-57fcbb8d-c474-4059-8832-86756de237f6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:22.332344 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-57fcbb8d-c474-4059-8832-86756de237f6 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 1.034143 Sep 03 01:33:22.333770 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 22/43] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:21 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:22.381478 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b65fa0bb-da35-4486-98ea-c91c8a59d891 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:22.382108 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b65fa0bb-da35-4486-98ea-c91c8a59d891 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:22.398885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b65fa0bb-da35-4486-98ea-c91c8a59d891 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:22.401294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b65fa0bb-da35-4486-98ea-c91c8a59d891 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:22.401899 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b65fa0bb-da35-4486-98ea-c91c8a59d891 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:22.402867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b65fa0bb-da35-4486-98ea-c91c8a59d891 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:22.403503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b65fa0bb-da35-4486-98ea-c91c8a59d891 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:22.404497 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b65fa0bb-da35-4486-98ea-c91c8a59d891 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:22.483596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9d8053b1-548b-4b90-b580-90e71de9837a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:22.500659 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9d8053b1-548b-4b90-b580-90e71de9837a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1282 microversion: 2.1 time: 0.330619 Sep 03 01:33:22.514862 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 22/44] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:22 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1282 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:22.591439 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b65fa0bb-da35-4486-98ea-c91c8a59d891 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:22.603051 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b65fa0bb-da35-4486-98ea-c91c8a59d891 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1245 microversion: 2.1 time: 0.239427 Sep 03 01:33:22.624050 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 23/45] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:22 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1245 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:22.705457 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-15a09e01-d705-4e41-9eee-36a3f0b7099e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:22.705776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-15a09e01-d705-4e41-9eee-36a3f0b7099e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:22.776702 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-15a09e01-d705-4e41-9eee-36a3f0b7099e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:22.785766 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-15a09e01-d705-4e41-9eee-36a3f0b7099e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1238 microversion: 2.1 time: 0.087970 Sep 03 01:33:22.786622 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 23/46] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:22 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1238 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:23.198024 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8bd0b9ae-9575-479c-882a-3815d4f3e36f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:23.198914 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8bd0b9ae-9575-479c-882a-3815d4f3e36f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:23.205551 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8bd0b9ae-9575-479c-882a-3815d4f3e36f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:23.206043 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8bd0b9ae-9575-479c-882a-3815d4f3e36f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:23.206517 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8bd0b9ae-9575-479c-882a-3815d4f3e36f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:23.207216 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8bd0b9ae-9575-479c-882a-3815d4f3e36f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:23.207697 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8bd0b9ae-9575-479c-882a-3815d4f3e36f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:23.208113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8bd0b9ae-9575-479c-882a-3815d4f3e36f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:23.283812 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8bd0b9ae-9575-479c-882a-3815d4f3e36f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:23.290766 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8bd0b9ae-9575-479c-882a-3815d4f3e36f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:23.297860 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8bd0b9ae-9575-479c-882a-3815d4f3e36f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:23.299311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8bd0b9ae-9575-479c-882a-3815d4f3e36f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1285 microversion: 2.20 time: 0.105942 Sep 03 01:33:23.300229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 24/47] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:23 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:23.365410 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-76f656a7-6a27-427f-9baa-3f53f0412281 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:23.366081 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-76f656a7-6a27-427f-9baa-3f53f0412281 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:23.373175 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76f656a7-6a27-427f-9baa-3f53f0412281 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:23.377018 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76f656a7-6a27-427f-9baa-3f53f0412281 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:23.377018 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76f656a7-6a27-427f-9baa-3f53f0412281 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:23.377018 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76f656a7-6a27-427f-9baa-3f53f0412281 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:23.377018 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76f656a7-6a27-427f-9baa-3f53f0412281 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:23.377330 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76f656a7-6a27-427f-9baa-3f53f0412281 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:23.537893 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4999d32d-bccc-4642-b861-0422924ebab8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:23.537893 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4999d32d-bccc-4642-b861-0422924ebab8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:23.557197 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4999d32d-bccc-4642-b861-0422924ebab8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:23.557713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4999d32d-bccc-4642-b861-0422924ebab8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:23.562290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4999d32d-bccc-4642-b861-0422924ebab8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:23.563218 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4999d32d-bccc-4642-b861-0422924ebab8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:23.566311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4999d32d-bccc-4642-b861-0422924ebab8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:23.566311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4999d32d-bccc-4642-b861-0422924ebab8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:23.683597 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4999d32d-bccc-4642-b861-0422924ebab8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:23.689000 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-76f656a7-6a27-427f-9baa-3f53f0412281 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:23.693160 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4999d32d-bccc-4642-b861-0422924ebab8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1292 microversion: 2.1 time: 0.160933 Sep 03 01:33:23.694318 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 25/48] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:23 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1292 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:23.704941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-76f656a7-6a27-427f-9baa-3f53f0412281 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.343633 Sep 03 01:33:23.711021 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 24/49] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:23 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:23.719948 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-95c9c64d-fc5b-402a-bb2f-60f6fda78b63 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:23.722139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-95c9c64d-fc5b-402a-bb2f-60f6fda78b63 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:23.735246 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95c9c64d-fc5b-402a-bb2f-60f6fda78b63 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:23.739691 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95c9c64d-fc5b-402a-bb2f-60f6fda78b63 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:23.740369 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95c9c64d-fc5b-402a-bb2f-60f6fda78b63 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:23.741314 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95c9c64d-fc5b-402a-bb2f-60f6fda78b63 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:23.741934 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95c9c64d-fc5b-402a-bb2f-60f6fda78b63 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:23.743218 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95c9c64d-fc5b-402a-bb2f-60f6fda78b63 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:23.808863 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-b8147b75-2c65-4054-8e41-012cc6bbd21c req-c6bacc96-7ce5-4f65-94fe-c0139084ae2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05cc922e-348e-42a7-a4ff-6b8ba6c91fad", "tag": "4b292e8b-d77c-4f44-9888-e42a1b3cbaef"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:23.829701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-b8147b75-2c65-4054-8e41-012cc6bbd21c req-c6bacc96-7ce5-4f65-94fe-c0139084ae2e service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:23.830701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-b8147b75-2c65-4054-8e41-012cc6bbd21c req-c6bacc96-7ce5-4f65-94fe-c0139084ae2e service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:23.831179 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-b8147b75-2c65-4054-8e41-012cc6bbd21c req-c6bacc96-7ce5-4f65-94fe-c0139084ae2e service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:23.856355 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-b8147b75-2c65-4054-8e41-012cc6bbd21c req-c6bacc96-7ce5-4f65-94fe-c0139084ae2e service nova] Creating event network-changed:4b292e8b-d77c-4f44-9888-e42a1b3cbaef for instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad on hv-cinder-83800 Sep 03 01:33:23.857127 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-b8147b75-2c65-4054-8e41-012cc6bbd21c req-c6bacc96-7ce5-4f65-94fe-c0139084ae2e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 01:33:23.857805 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-b8147b75-2c65-4054-8e41-012cc6bbd21c req-c6bacc96-7ce5-4f65-94fe-c0139084ae2e service nova] Acquired lock "compute-rpcapi-router" {{(pid=127553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 01:33:23.859683 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa33f3fd-1406-4fa7-b37a-2ff92005a2a2 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:23.860298 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa33f3fd-1406-4fa7-b37a-2ff92005a2a2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:23.864288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa33f3fd-1406-4fa7-b37a-2ff92005a2a2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:23.864288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa33f3fd-1406-4fa7-b37a-2ff92005a2a2 None None] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:23.864288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa33f3fd-1406-4fa7-b37a-2ff92005a2a2 None None] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:23.864288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa33f3fd-1406-4fa7-b37a-2ff92005a2a2 None None] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:23.864700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-95c9c64d-fc5b-402a-bb2f-60f6fda78b63 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:23.873922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.compute.rpcapi [None req-aa33f3fd-1406-4fa7-b37a-2ff92005a2a2 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 03 01:33:23.875268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa33f3fd-1406-4fa7-b37a-2ff92005a2a2 None None] Releasing lock "compute-rpcapi-router" {{(pid=127553) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 01:33:23.884395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-95c9c64d-fc5b-402a-bb2f-60f6fda78b63 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1245 microversion: 2.1 time: 0.172008 Sep 03 01:33:23.891363 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 25/50] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:23 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1245 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:23.905689 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-95cbf96c-aac8-441e-bc59-f046a25a2e81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:23.907425 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-95cbf96c-aac8-441e-bc59-f046a25a2e81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:23.911695 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-aa33f3fd-1406-4fa7-b37a-2ff92005a2a2 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215992 Sep 03 01:33:23.915342 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 26/51] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:33:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:23.964517 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95cbf96c-aac8-441e-bc59-f046a25a2e81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:23.966725 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95cbf96c-aac8-441e-bc59-f046a25a2e81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:23.967416 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95cbf96c-aac8-441e-bc59-f046a25a2e81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:23.973139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95cbf96c-aac8-441e-bc59-f046a25a2e81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:23.975318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95cbf96c-aac8-441e-bc59-f046a25a2e81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:23.975977 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95cbf96c-aac8-441e-bc59-f046a25a2e81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:24.136299 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-95cbf96c-aac8-441e-bc59-f046a25a2e81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:24.145508 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-95cbf96c-aac8-441e-bc59-f046a25a2e81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1242 microversion: 2.1 time: 0.250640 Sep 03 01:33:24.163224 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 26/52] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:23 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1242 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:24.327294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c2b1b502-49a4-46bc-b71c-3a5071e3eb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:24.327984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c2b1b502-49a4-46bc-b71c-3a5071e3eb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:24.361386 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c2b1b502-49a4-46bc-b71c-3a5071e3eb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:24.362058 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c2b1b502-49a4-46bc-b71c-3a5071e3eb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:24.362727 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c2b1b502-49a4-46bc-b71c-3a5071e3eb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:24.364075 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c2b1b502-49a4-46bc-b71c-3a5071e3eb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:24.364728 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c2b1b502-49a4-46bc-b71c-3a5071e3eb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:24.365321 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c2b1b502-49a4-46bc-b71c-3a5071e3eb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:24.479451 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c2b1b502-49a4-46bc-b71c-3a5071e3eb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:24.502765 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c2b1b502-49a4-46bc-b71c-3a5071e3eb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:24.511251 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c2b1b502-49a4-46bc-b71c-3a5071e3eb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:24.512420 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c2b1b502-49a4-46bc-b71c-3a5071e3eb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1285 microversion: 2.20 time: 0.190090 Sep 03 01:33:24.512999 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 27/53] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:24 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:24.734898 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a3478456-e6a7-49a3-8ef3-e5ac79d2f731 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:24.735579 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a3478456-e6a7-49a3-8ef3-e5ac79d2f731 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:24.738011 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a464ef72-90c6-4c01-8e45-0e2a23f7e9fa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:24.739405 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a464ef72-90c6-4c01-8e45-0e2a23f7e9fa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:24.747197 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a464ef72-90c6-4c01-8e45-0e2a23f7e9fa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:24.748006 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a464ef72-90c6-4c01-8e45-0e2a23f7e9fa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:24.748785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a464ef72-90c6-4c01-8e45-0e2a23f7e9fa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:24.748955 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3478456-e6a7-49a3-8ef3-e5ac79d2f731 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:24.749405 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3478456-e6a7-49a3-8ef3-e5ac79d2f731 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:24.749826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3478456-e6a7-49a3-8ef3-e5ac79d2f731 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:24.750538 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a464ef72-90c6-4c01-8e45-0e2a23f7e9fa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:24.751142 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a464ef72-90c6-4c01-8e45-0e2a23f7e9fa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:24.752112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a464ef72-90c6-4c01-8e45-0e2a23f7e9fa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:24.761470 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3478456-e6a7-49a3-8ef3-e5ac79d2f731 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:24.763098 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3478456-e6a7-49a3-8ef3-e5ac79d2f731 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:24.763558 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3478456-e6a7-49a3-8ef3-e5ac79d2f731 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:25.327794 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a464ef72-90c6-4c01-8e45-0e2a23f7e9fa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:25.337083 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a464ef72-90c6-4c01-8e45-0e2a23f7e9fa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1292 microversion: 2.1 time: 0.607386 Sep 03 01:33:25.342961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 27/54] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:24 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1292 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:25.359799 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-51101284-16aa-450a-9345-647eb79b7e40 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:25.361159 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-51101284-16aa-450a-9345-647eb79b7e40 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:25.376598 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51101284-16aa-450a-9345-647eb79b7e40 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:25.381326 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51101284-16aa-450a-9345-647eb79b7e40 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:25.385174 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51101284-16aa-450a-9345-647eb79b7e40 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:25.385618 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a3478456-e6a7-49a3-8ef3-e5ac79d2f731 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:25.386516 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51101284-16aa-450a-9345-647eb79b7e40 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:25.387242 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51101284-16aa-450a-9345-647eb79b7e40 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:25.394653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51101284-16aa-450a-9345-647eb79b7e40 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:25.398885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a3478456-e6a7-49a3-8ef3-e5ac79d2f731 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.667454 Sep 03 01:33:25.401046 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 28/55] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:24 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:25.413427 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8d3fcb5d-46e3-4ce9-9263-dcbb9206600c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:25.417660 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8d3fcb5d-46e3-4ce9-9263-dcbb9206600c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:25.431230 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8d3fcb5d-46e3-4ce9-9263-dcbb9206600c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:25.431991 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8d3fcb5d-46e3-4ce9-9263-dcbb9206600c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:25.432588 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8d3fcb5d-46e3-4ce9-9263-dcbb9206600c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:25.435912 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8d3fcb5d-46e3-4ce9-9263-dcbb9206600c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:25.436759 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8d3fcb5d-46e3-4ce9-9263-dcbb9206600c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:25.437412 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8d3fcb5d-46e3-4ce9-9263-dcbb9206600c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:25.677886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8d3fcb5d-46e3-4ce9-9263-dcbb9206600c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:25.737937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8d3fcb5d-46e3-4ce9-9263-dcbb9206600c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1234 microversion: 2.1 time: 0.335071 Sep 03 01:33:25.741743 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 29/56] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:25 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1234 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:25.770923 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7b8d149d-24ed-4093-9c77-8b6f451ddda6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:25.774187 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7b8d149d-24ed-4093-9c77-8b6f451ddda6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:25.808858 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7b8d149d-24ed-4093-9c77-8b6f451ddda6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:25.811316 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7b8d149d-24ed-4093-9c77-8b6f451ddda6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:25.812910 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7b8d149d-24ed-4093-9c77-8b6f451ddda6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:25.817723 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7b8d149d-24ed-4093-9c77-8b6f451ddda6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:25.818629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7b8d149d-24ed-4093-9c77-8b6f451ddda6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:25.819315 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7b8d149d-24ed-4093-9c77-8b6f451ddda6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:25.820815 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-51101284-16aa-450a-9345-647eb79b7e40 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:25.847386 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-51101284-16aa-450a-9345-647eb79b7e40 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1245 microversion: 2.1 time: 0.499605 Sep 03 01:33:25.852494 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 28/57] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:25 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1245 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:26.272094 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7b8d149d-24ed-4093-9c77-8b6f451ddda6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:26.295015 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7b8d149d-24ed-4093-9c77-8b6f451ddda6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:26.299230 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7b8d149d-24ed-4093-9c77-8b6f451ddda6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:26.306721 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7b8d149d-24ed-4093-9c77-8b6f451ddda6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1277 microversion: 2.20 time: 0.555063 Sep 03 01:33:26.315992 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 30/58] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:25 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1277 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:26.372845 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-65f6f780-497b-44de-9e7b-dfda142bc9be tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:26.378802 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-65f6f780-497b-44de-9e7b-dfda142bc9be tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:26.401869 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-65f6f780-497b-44de-9e7b-dfda142bc9be tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:26.401869 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-65f6f780-497b-44de-9e7b-dfda142bc9be tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:26.420896 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-65f6f780-497b-44de-9e7b-dfda142bc9be tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:26.421924 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-65f6f780-497b-44de-9e7b-dfda142bc9be tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:26.422155 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-65f6f780-497b-44de-9e7b-dfda142bc9be tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:26.442363 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-65f6f780-497b-44de-9e7b-dfda142bc9be tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:26.442573 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0719a2bd-3af8-433f-85bc-87bd8a927f88 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:26.442573 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-0719a2bd-3af8-433f-85bc-87bd8a927f88 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:26.456384 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0719a2bd-3af8-433f-85bc-87bd8a927f88 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:26.457113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0719a2bd-3af8-433f-85bc-87bd8a927f88 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:26.457808 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0719a2bd-3af8-433f-85bc-87bd8a927f88 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:26.465157 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0719a2bd-3af8-433f-85bc-87bd8a927f88 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:26.465157 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0719a2bd-3af8-433f-85bc-87bd8a927f88 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:26.465157 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0719a2bd-3af8-433f-85bc-87bd8a927f88 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:27.065923 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-65f6f780-497b-44de-9e7b-dfda142bc9be tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:27.086690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-65f6f780-497b-44de-9e7b-dfda142bc9be tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1280 microversion: 2.1 time: 0.713542 Sep 03 01:33:27.086690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 29/59] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:26 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1280 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:27.120157 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-1dce7e33-d914-4348-b643-6542426d4534 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:27.120794 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-1dce7e33-d914-4348-b643-6542426d4534 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:27.134994 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-0719a2bd-3af8-433f-85bc-87bd8a927f88 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:27.137916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1dce7e33-d914-4348-b643-6542426d4534 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:27.138619 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1dce7e33-d914-4348-b643-6542426d4534 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:27.139585 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1dce7e33-d914-4348-b643-6542426d4534 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:27.140433 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1dce7e33-d914-4348-b643-6542426d4534 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:27.141034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1dce7e33-d914-4348-b643-6542426d4534 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:27.141630 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1dce7e33-d914-4348-b643-6542426d4534 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:27.144864 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0719a2bd-3af8-433f-85bc-87bd8a927f88 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.721478 Sep 03 01:33:27.145745 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 31/60] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:26 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:27.159398 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-38a2aa5a-0a9e-4545-b805-fc0654a10aa6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:27.159398 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-38a2aa5a-0a9e-4545-b805-fc0654a10aa6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:27.169829 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-38a2aa5a-0a9e-4545-b805-fc0654a10aa6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:27.170684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-38a2aa5a-0a9e-4545-b805-fc0654a10aa6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:27.171240 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-38a2aa5a-0a9e-4545-b805-fc0654a10aa6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:27.172064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-38a2aa5a-0a9e-4545-b805-fc0654a10aa6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:27.172629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-38a2aa5a-0a9e-4545-b805-fc0654a10aa6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:27.173163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-38a2aa5a-0a9e-4545-b805-fc0654a10aa6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:27.288673 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-38a2aa5a-0a9e-4545-b805-fc0654a10aa6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:27.298852 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-38a2aa5a-0a9e-4545-b805-fc0654a10aa6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1293 microversion: 2.1 time: 0.151486 Sep 03 01:33:27.301450 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 32/61] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:27 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1293 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:27.335229 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1dce7e33-d914-4348-b643-6542426d4534 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:27.336516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d218f67d-e31b-44ac-bbd8-e4cb23f5cec0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:27.337451 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d218f67d-e31b-44ac-bbd8-e4cb23f5cec0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:27.348398 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:27.354250 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d218f67d-e31b-44ac-bbd8-e4cb23f5cec0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:27.354849 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d218f67d-e31b-44ac-bbd8-e4cb23f5cec0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:27.355285 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d218f67d-e31b-44ac-bbd8-e4cb23f5cec0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:27.355419 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-1dce7e33-d914-4348-b643-6542426d4534 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1290 microversion: 2.1 time: 0.275599 Sep 03 01:33:27.356018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d218f67d-e31b-44ac-bbd8-e4cb23f5cec0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:27.356463 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d218f67d-e31b-44ac-bbd8-e4cb23f5cec0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:27.357051 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d218f67d-e31b-44ac-bbd8-e4cb23f5cec0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:27.361021 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 30/62] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:27 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1290 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:27.495814 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d218f67d-e31b-44ac-bbd8-e4cb23f5cec0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:27.522856 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d218f67d-e31b-44ac-bbd8-e4cb23f5cec0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:27.528548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d218f67d-e31b-44ac-bbd8-e4cb23f5cec0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:27.532586 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d218f67d-e31b-44ac-bbd8-e4cb23f5cec0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1333 microversion: 2.20 time: 0.200003 Sep 03 01:33:27.533636 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 33/63] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:27 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1333 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:28.102780 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6b1434db-8705-4d40-a690-1545b9e72070 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:28.104597 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6b1434db-8705-4d40-a690-1545b9e72070 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:28.118987 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6b1434db-8705-4d40-a690-1545b9e72070 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:28.119555 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6b1434db-8705-4d40-a690-1545b9e72070 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:28.120005 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6b1434db-8705-4d40-a690-1545b9e72070 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:28.120864 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6b1434db-8705-4d40-a690-1545b9e72070 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:28.124729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6b1434db-8705-4d40-a690-1545b9e72070 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:28.126550 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6b1434db-8705-4d40-a690-1545b9e72070 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:28.170211 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1c287692-5879-4564-afa3-be43ab84e038 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:28.171378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1c287692-5879-4564-afa3-be43ab84e038 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:28.179209 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1c287692-5879-4564-afa3-be43ab84e038 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:28.181250 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1c287692-5879-4564-afa3-be43ab84e038 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:28.182866 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1c287692-5879-4564-afa3-be43ab84e038 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:28.186624 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1c287692-5879-4564-afa3-be43ab84e038 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:28.187317 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1c287692-5879-4564-afa3-be43ab84e038 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:28.187928 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1c287692-5879-4564-afa3-be43ab84e038 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:28.296093 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6b1434db-8705-4d40-a690-1545b9e72070 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:28.324338 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6b1434db-8705-4d40-a690-1545b9e72070 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1280 microversion: 2.1 time: 0.226857 Sep 03 01:33:28.330931 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 31/64] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:28 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1280 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:28.390692 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-400bbe1e-aa2d-4f43-8bd0-541fbd5551ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:28.391337 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-400bbe1e-aa2d-4f43-8bd0-541fbd5551ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:28.402575 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-400bbe1e-aa2d-4f43-8bd0-541fbd5551ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:28.402575 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-400bbe1e-aa2d-4f43-8bd0-541fbd5551ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:28.402575 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-400bbe1e-aa2d-4f43-8bd0-541fbd5551ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:28.402575 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-400bbe1e-aa2d-4f43-8bd0-541fbd5551ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:28.425720 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-400bbe1e-aa2d-4f43-8bd0-541fbd5551ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:28.426051 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-400bbe1e-aa2d-4f43-8bd0-541fbd5551ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:28.550393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1c287692-5879-4564-afa3-be43ab84e038 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:28.559768 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1c287692-5879-4564-afa3-be43ab84e038 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.393752 Sep 03 01:33:28.563697 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 34/65] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:28 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:28.588373 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-385c33f3-1e45-43a2-9e3c-10fe4bf5c651 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:28.592318 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-385c33f3-1e45-43a2-9e3c-10fe4bf5c651 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:28.606479 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-385c33f3-1e45-43a2-9e3c-10fe4bf5c651 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:28.607052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-385c33f3-1e45-43a2-9e3c-10fe4bf5c651 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:28.608192 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-385c33f3-1e45-43a2-9e3c-10fe4bf5c651 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:28.608404 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-385c33f3-1e45-43a2-9e3c-10fe4bf5c651 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:28.609467 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-385c33f3-1e45-43a2-9e3c-10fe4bf5c651 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:28.610102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-385c33f3-1e45-43a2-9e3c-10fe4bf5c651 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:28.619134 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=100 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:28.715761 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-385c33f3-1e45-43a2-9e3c-10fe4bf5c651 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:28.736113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-385c33f3-1e45-43a2-9e3c-10fe4bf5c651 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1290 microversion: 2.1 time: 0.169521 Sep 03 01:33:28.744284 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 35/66] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:28 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1290 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:28.760139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b5f0dca2-99c6-4720-9cd3-164ec96e91d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:28.760941 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b5f0dca2-99c6-4720-9cd3-164ec96e91d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:28.763102 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-400bbe1e-aa2d-4f43-8bd0-541fbd5551ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:28.767726 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b5f0dca2-99c6-4720-9cd3-164ec96e91d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:28.775356 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b5f0dca2-99c6-4720-9cd3-164ec96e91d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:28.775963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b5f0dca2-99c6-4720-9cd3-164ec96e91d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:28.776586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-400bbe1e-aa2d-4f43-8bd0-541fbd5551ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1293 microversion: 2.1 time: 0.443540 Sep 03 01:33:28.778978 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b5f0dca2-99c6-4720-9cd3-164ec96e91d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:28.779624 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b5f0dca2-99c6-4720-9cd3-164ec96e91d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:28.780454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b5f0dca2-99c6-4720-9cd3-164ec96e91d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:28.788204 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 32/67] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:28 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1293 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:28.909657 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b5f0dca2-99c6-4720-9cd3-164ec96e91d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:28.918682 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b5f0dca2-99c6-4720-9cd3-164ec96e91d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:28.920432 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b5f0dca2-99c6-4720-9cd3-164ec96e91d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:28.921525 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b5f0dca2-99c6-4720-9cd3-164ec96e91d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1333 microversion: 2.20 time: 0.176277 Sep 03 01:33:28.927061 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 36/68] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:28 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1333 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:29.232721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-3ba42cc0-1b1f-49fc-80f3-6a41d91e07ef req-dace60da-7878-4663-86c8-be0be027fe8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dea4f761-54b0-4e77-9d84-5143f79c4e8a", "tag": "e5fef679-f9d4-4ff4-99a4-3e18be20bd06"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:29.257139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-3ba42cc0-1b1f-49fc-80f3-6a41d91e07ef req-dace60da-7878-4663-86c8-be0be027fe8b service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:29.258220 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-3ba42cc0-1b1f-49fc-80f3-6a41d91e07ef req-dace60da-7878-4663-86c8-be0be027fe8b service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:29.260235 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-3ba42cc0-1b1f-49fc-80f3-6a41d91e07ef req-dace60da-7878-4663-86c8-be0be027fe8b service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:29.311959 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-3ba42cc0-1b1f-49fc-80f3-6a41d91e07ef req-dace60da-7878-4663-86c8-be0be027fe8b service nova] Creating event network-changed:e5fef679-f9d4-4ff4-99a4-3e18be20bd06 for instance dea4f761-54b0-4e77-9d84-5143f79c4e8a on hv-cinder-83800 Sep 03 01:33:29.312828 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-3ba42cc0-1b1f-49fc-80f3-6a41d91e07ef req-dace60da-7878-4663-86c8-be0be027fe8b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127552) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 03 01:33:29.313360 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-3ba42cc0-1b1f-49fc-80f3-6a41d91e07ef req-dace60da-7878-4663-86c8-be0be027fe8b service nova] Acquired lock "compute-rpcapi-router" {{(pid=127552) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 03 01:33:29.314570 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ba82734b-733b-4dc6-baeb-c1196d3f3c7f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:29.315196 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ba82734b-733b-4dc6-baeb-c1196d3f3c7f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:29.315762 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ba82734b-733b-4dc6-baeb-c1196d3f3c7f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:29.316629 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ba82734b-733b-4dc6-baeb-c1196d3f3c7f None None] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:29.317229 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ba82734b-733b-4dc6-baeb-c1196d3f3c7f None None] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:29.317784 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ba82734b-733b-4dc6-baeb-c1196d3f3c7f None None] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:29.329733 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.compute.rpcapi [None req-ba82734b-733b-4dc6-baeb-c1196d3f3c7f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 03 01:33:29.330816 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ba82734b-733b-4dc6-baeb-c1196d3f3c7f None None] Releasing lock "compute-rpcapi-router" {{(pid=127552) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 03 01:33:29.354406 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b81cfed0-5e66-4a7e-9215-bb1ce0e31789 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:29.355585 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b81cfed0-5e66-4a7e-9215-bb1ce0e31789 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:29.371095 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ba82734b-733b-4dc6-baeb-c1196d3f3c7f None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.553554 Sep 03 01:33:29.372260 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 33/69] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:33:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:29.373484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b81cfed0-5e66-4a7e-9215-bb1ce0e31789 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:29.375507 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b81cfed0-5e66-4a7e-9215-bb1ce0e31789 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:29.376116 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b81cfed0-5e66-4a7e-9215-bb1ce0e31789 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:29.378245 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b81cfed0-5e66-4a7e-9215-bb1ce0e31789 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:29.379071 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b81cfed0-5e66-4a7e-9215-bb1ce0e31789 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:29.381416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b81cfed0-5e66-4a7e-9215-bb1ce0e31789 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:29.590043 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-71cca65b-d7d7-4f91-898e-8b506d8373a0 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:29.590949 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-71cca65b-d7d7-4f91-898e-8b506d8373a0 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:29.603270 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71cca65b-d7d7-4f91-898e-8b506d8373a0 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:29.605250 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71cca65b-d7d7-4f91-898e-8b506d8373a0 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:29.606164 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71cca65b-d7d7-4f91-898e-8b506d8373a0 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:29.608548 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71cca65b-d7d7-4f91-898e-8b506d8373a0 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:29.612780 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71cca65b-d7d7-4f91-898e-8b506d8373a0 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:29.612780 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71cca65b-d7d7-4f91-898e-8b506d8373a0 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:29.644445 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b81cfed0-5e66-4a7e-9215-bb1ce0e31789 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:29.653181 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b81cfed0-5e66-4a7e-9215-bb1ce0e31789 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.303981 Sep 03 01:33:29.653794 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 37/70] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:29 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:29.775020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ca395db9-c6e4-4819-9831-57f59a91872f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:29.775997 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ca395db9-c6e4-4819-9831-57f59a91872f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:29.785421 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ca395db9-c6e4-4819-9831-57f59a91872f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:29.787883 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ca395db9-c6e4-4819-9831-57f59a91872f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:29.790877 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ca395db9-c6e4-4819-9831-57f59a91872f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:29.794710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ca395db9-c6e4-4819-9831-57f59a91872f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:29.794710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ca395db9-c6e4-4819-9831-57f59a91872f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:29.794710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ca395db9-c6e4-4819-9831-57f59a91872f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:29.856270 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-71cca65b-d7d7-4f91-898e-8b506d8373a0 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:29.865235 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-71cca65b-d7d7-4f91-898e-8b506d8373a0 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.282058 Sep 03 01:33:29.879548 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 34/71] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:29 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:29.886674 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2dc58ed3-f6fb-4fb8-8566-7be525e0a0db tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:29.887537 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2dc58ed3-f6fb-4fb8-8566-7be525e0a0db tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:29.922939 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ca395db9-c6e4-4819-9831-57f59a91872f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:29.935702 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ca395db9-c6e4-4819-9831-57f59a91872f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1298 microversion: 2.1 time: 0.166043 Sep 03 01:33:29.935871 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2dc58ed3-f6fb-4fb8-8566-7be525e0a0db tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:29.936296 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2dc58ed3-f6fb-4fb8-8566-7be525e0a0db tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:29.937143 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2dc58ed3-f6fb-4fb8-8566-7be525e0a0db tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:29.937872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2dc58ed3-f6fb-4fb8-8566-7be525e0a0db tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:29.938328 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2dc58ed3-f6fb-4fb8-8566-7be525e0a0db tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:29.939345 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 38/72] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:29 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1298 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:29.940701 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2dc58ed3-f6fb-4fb8-8566-7be525e0a0db tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:29.957039 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8ce3fd3c-79f4-4d19-ae1c-3d1896d5b3a3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:29.959289 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8ce3fd3c-79f4-4d19-ae1c-3d1896d5b3a3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:29.985272 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8ce3fd3c-79f4-4d19-ae1c-3d1896d5b3a3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:29.986162 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8ce3fd3c-79f4-4d19-ae1c-3d1896d5b3a3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:29.990193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8ce3fd3c-79f4-4d19-ae1c-3d1896d5b3a3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:29.994089 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8ce3fd3c-79f4-4d19-ae1c-3d1896d5b3a3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:29.995335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8ce3fd3c-79f4-4d19-ae1c-3d1896d5b3a3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:29.996276 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8ce3fd3c-79f4-4d19-ae1c-3d1896d5b3a3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:30.034713 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:30.572434 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2dc58ed3-f6fb-4fb8-8566-7be525e0a0db tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:30.605686 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2dc58ed3-f6fb-4fb8-8566-7be525e0a0db tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1293 microversion: 2.1 time: 0.724597 Sep 03 01:33:30.608498 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 35/73] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:29 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1293 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:30.627195 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8ce3fd3c-79f4-4d19-ae1c-3d1896d5b3a3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:30.658577 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8ce3fd3c-79f4-4d19-ae1c-3d1896d5b3a3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:30.658577 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8ce3fd3c-79f4-4d19-ae1c-3d1896d5b3a3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:30.658577 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8ce3fd3c-79f4-4d19-ae1c-3d1896d5b3a3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1341 microversion: 2.20 time: 0.712606 Sep 03 01:33:30.673220 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 39/74] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:29 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1341 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:30.679272 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b9a4fa61-4fa3-4bf3-82e3-ff1563aa29c4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:30.680036 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b9a4fa61-4fa3-4bf3-82e3-ff1563aa29c4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:30.693430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b9a4fa61-4fa3-4bf3-82e3-ff1563aa29c4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:30.725121 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b9a4fa61-4fa3-4bf3-82e3-ff1563aa29c4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:30.727591 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b9a4fa61-4fa3-4bf3-82e3-ff1563aa29c4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:30.730021 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b9a4fa61-4fa3-4bf3-82e3-ff1563aa29c4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:30.736114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b9a4fa61-4fa3-4bf3-82e3-ff1563aa29c4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:30.738235 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b9a4fa61-4fa3-4bf3-82e3-ff1563aa29c4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:30.890046 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1b2fc429-e50c-4796-9f86-5572881f8b75 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:30.890879 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1b2fc429-e50c-4796-9f86-5572881f8b75 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:30.907388 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1b2fc429-e50c-4796-9f86-5572881f8b75 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:30.907713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1b2fc429-e50c-4796-9f86-5572881f8b75 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:30.908136 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1b2fc429-e50c-4796-9f86-5572881f8b75 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:30.908837 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1b2fc429-e50c-4796-9f86-5572881f8b75 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:30.913208 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1b2fc429-e50c-4796-9f86-5572881f8b75 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:30.913785 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1b2fc429-e50c-4796-9f86-5572881f8b75 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:31.273346 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=26 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:31.708679 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1b2fc429-e50c-4796-9f86-5572881f8b75 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:31.718983 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1b2fc429-e50c-4796-9f86-5572881f8b75 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.832981 Sep 03 01:33:31.731460 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 40/75] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:30 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:31.737282 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-298e0c97-71a3-484c-ab8a-f979e2acf872 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:31.752744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-298e0c97-71a3-484c-ab8a-f979e2acf872 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:31.761341 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-298e0c97-71a3-484c-ab8a-f979e2acf872 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:31.762035 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-298e0c97-71a3-484c-ab8a-f979e2acf872 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:31.762560 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-298e0c97-71a3-484c-ab8a-f979e2acf872 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:31.763427 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-298e0c97-71a3-484c-ab8a-f979e2acf872 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:31.764064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-298e0c97-71a3-484c-ab8a-f979e2acf872 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:31.764746 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-298e0c97-71a3-484c-ab8a-f979e2acf872 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:31.953871 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-298e0c97-71a3-484c-ab8a-f979e2acf872 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:31.978188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-298e0c97-71a3-484c-ab8a-f979e2acf872 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1296 microversion: 2.1 time: 0.244693 Sep 03 01:33:32.002782 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 41/76] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:31 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1296 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:32.012891 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-dab23836-eff1-46f7-867b-df2eb8f60653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:32.013091 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b9a4fa61-4fa3-4bf3-82e3-ff1563aa29c4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:32.014222 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-dab23836-eff1-46f7-867b-df2eb8f60653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:32.021228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b9a4fa61-4fa3-4bf3-82e3-ff1563aa29c4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 1.345988 Sep 03 01:33:32.021466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dab23836-eff1-46f7-867b-df2eb8f60653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:32.034378 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 36/77] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:30 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 1347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:32.034378 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-037543d1-3b7c-4690-ad82-f31f61dc66aa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:32.034378 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-037543d1-3b7c-4690-ad82-f31f61dc66aa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:32.036215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dab23836-eff1-46f7-867b-df2eb8f60653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:32.036919 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dab23836-eff1-46f7-867b-df2eb8f60653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:32.042886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dab23836-eff1-46f7-867b-df2eb8f60653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:32.044056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dab23836-eff1-46f7-867b-df2eb8f60653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:32.044704 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dab23836-eff1-46f7-867b-df2eb8f60653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:32.051047 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-037543d1-3b7c-4690-ad82-f31f61dc66aa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:32.057030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-037543d1-3b7c-4690-ad82-f31f61dc66aa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:32.057030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-037543d1-3b7c-4690-ad82-f31f61dc66aa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:32.057030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-037543d1-3b7c-4690-ad82-f31f61dc66aa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:32.057030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-037543d1-3b7c-4690-ad82-f31f61dc66aa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:32.057383 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-037543d1-3b7c-4690-ad82-f31f61dc66aa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:32.169989 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-037543d1-3b7c-4690-ad82-f31f61dc66aa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:32.188961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-037543d1-3b7c-4690-ad82-f31f61dc66aa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:32.188961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-037543d1-3b7c-4690-ad82-f31f61dc66aa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:32.188961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-037543d1-3b7c-4690-ad82-f31f61dc66aa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1339 microversion: 2.20 time: 0.164355 Sep 03 01:33:32.189331 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 37/78] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:32 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1339 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:32.208396 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-dab23836-eff1-46f7-867b-df2eb8f60653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:32.217476 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-dab23836-eff1-46f7-867b-df2eb8f60653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1299 microversion: 2.1 time: 0.213216 Sep 03 01:33:32.219758 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 42/79] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:32 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1299 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:32.755078 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e5956605-ce1b-40c5-b5df-da62210281cb tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:32.756032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e5956605-ce1b-40c5-b5df-da62210281cb tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:32.765074 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5956605-ce1b-40c5-b5df-da62210281cb tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:32.771690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5956605-ce1b-40c5-b5df-da62210281cb tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:32.772454 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5956605-ce1b-40c5-b5df-da62210281cb tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:32.778910 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5956605-ce1b-40c5-b5df-da62210281cb tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:32.779853 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5956605-ce1b-40c5-b5df-da62210281cb tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:32.781583 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5956605-ce1b-40c5-b5df-da62210281cb tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:32.794395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=40 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:33.035173 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c5848608-30c9-4307-b457-ea61fea9d071 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:33.046001 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c5848608-30c9-4307-b457-ea61fea9d071 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:33.061559 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c5848608-30c9-4307-b457-ea61fea9d071 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:33.063702 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c5848608-30c9-4307-b457-ea61fea9d071 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:33.066026 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c5848608-30c9-4307-b457-ea61fea9d071 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:33.067082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c5848608-30c9-4307-b457-ea61fea9d071 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:33.067689 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c5848608-30c9-4307-b457-ea61fea9d071 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:33.069832 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c5848608-30c9-4307-b457-ea61fea9d071 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:33.268800 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e5956605-ce1b-40c5-b5df-da62210281cb tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:33.278033 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e5956605-ce1b-40c5-b5df-da62210281cb tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.527267 Sep 03 01:33:33.278641 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 38/80] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:32 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:33.317667 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9a9f9e5b-2e7a-4050-ba1b-fa1384dcc4e3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:33.321216 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9a9f9e5b-2e7a-4050-ba1b-fa1384dcc4e3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:33.335257 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a9f9e5b-2e7a-4050-ba1b-fa1384dcc4e3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:33.336569 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a9f9e5b-2e7a-4050-ba1b-fa1384dcc4e3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:33.337131 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a9f9e5b-2e7a-4050-ba1b-fa1384dcc4e3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:33.338062 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a9f9e5b-2e7a-4050-ba1b-fa1384dcc4e3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:33.338612 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a9f9e5b-2e7a-4050-ba1b-fa1384dcc4e3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:33.339297 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a9f9e5b-2e7a-4050-ba1b-fa1384dcc4e3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:33.599138 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c5848608-30c9-4307-b457-ea61fea9d071 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:33.609524 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c5848608-30c9-4307-b457-ea61fea9d071 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1296 microversion: 2.1 time: 0.586914 Sep 03 01:33:33.622881 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 43/81] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:33 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1296 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:33.639822 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-57edcd02-a8f3-4eeb-a7d5-405fe30485b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:33.639822 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-57edcd02-a8f3-4eeb-a7d5-405fe30485b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:33.649976 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57edcd02-a8f3-4eeb-a7d5-405fe30485b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:33.650552 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57edcd02-a8f3-4eeb-a7d5-405fe30485b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:33.652672 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57edcd02-a8f3-4eeb-a7d5-405fe30485b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:33.653437 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57edcd02-a8f3-4eeb-a7d5-405fe30485b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:33.653903 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57edcd02-a8f3-4eeb-a7d5-405fe30485b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:33.654399 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57edcd02-a8f3-4eeb-a7d5-405fe30485b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:33.839825 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9a9f9e5b-2e7a-4050-ba1b-fa1384dcc4e3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:33.863666 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9a9f9e5b-2e7a-4050-ba1b-fa1384dcc4e3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.569614 Sep 03 01:33:33.863666 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 39/82] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:33 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:33.871997 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=6 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:33.880167 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-eea056d1-086c-4fd7-8140-671200cd81e4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:33.881647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-eea056d1-086c-4fd7-8140-671200cd81e4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:33.892960 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-eea056d1-086c-4fd7-8140-671200cd81e4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:33.902429 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-eea056d1-086c-4fd7-8140-671200cd81e4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:33.903121 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-eea056d1-086c-4fd7-8140-671200cd81e4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:33.904534 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-eea056d1-086c-4fd7-8140-671200cd81e4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:33.905455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-eea056d1-086c-4fd7-8140-671200cd81e4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:33.906056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-eea056d1-086c-4fd7-8140-671200cd81e4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:34.009720 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-eea056d1-086c-4fd7-8140-671200cd81e4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:34.012525 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-57edcd02-a8f3-4eeb-a7d5-405fe30485b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:34.017853 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-eea056d1-086c-4fd7-8140-671200cd81e4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1299 microversion: 2.1 time: 0.163533 Sep 03 01:33:34.024671 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-57edcd02-a8f3-4eeb-a7d5-405fe30485b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:34.025379 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 40/83] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:33 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1299 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:34.026565 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-57edcd02-a8f3-4eeb-a7d5-405fe30485b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:34.028897 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-57edcd02-a8f3-4eeb-a7d5-405fe30485b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1339 microversion: 2.20 time: 0.404875 Sep 03 01:33:34.030111 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 44/84] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:33 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1339 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:34.032529 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-bee7b814-a33b-437a-9b0c-f923b7f59949 req-1337c6bc-2231-4c32-96f7-4e126e53c798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "615f8d7e-2e14-4015-a24f-2b02e885ef44", "tag": "9ab23d97-93c5-443a-a734-fe9f47c27341"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:34.042982 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-bee7b814-a33b-437a-9b0c-f923b7f59949 req-1337c6bc-2231-4c32-96f7-4e126e53c798 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:34.043586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-bee7b814-a33b-437a-9b0c-f923b7f59949 req-1337c6bc-2231-4c32-96f7-4e126e53c798 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:34.044116 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-bee7b814-a33b-437a-9b0c-f923b7f59949 req-1337c6bc-2231-4c32-96f7-4e126e53c798 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:34.055252 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-bee7b814-a33b-437a-9b0c-f923b7f59949 req-1337c6bc-2231-4c32-96f7-4e126e53c798 service nova] Creating event network-changed:9ab23d97-93c5-443a-a734-fe9f47c27341 for instance 615f8d7e-2e14-4015-a24f-2b02e885ef44 on hv-cinder-83800 Sep 03 01:33:34.060468 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-bee7b814-a33b-437a-9b0c-f923b7f59949 req-1337c6bc-2231-4c32-96f7-4e126e53c798 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032973 Sep 03 01:33:34.061080 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 41/85] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:34.315913 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-27be19dd-7197-4cde-9aee-0adaa27a3412 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:34.318636 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-27be19dd-7197-4cde-9aee-0adaa27a3412 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:34.331945 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-27be19dd-7197-4cde-9aee-0adaa27a3412 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:34.332810 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-27be19dd-7197-4cde-9aee-0adaa27a3412 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:34.333432 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-27be19dd-7197-4cde-9aee-0adaa27a3412 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:34.334475 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-27be19dd-7197-4cde-9aee-0adaa27a3412 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:34.335097 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-27be19dd-7197-4cde-9aee-0adaa27a3412 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:34.335778 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-27be19dd-7197-4cde-9aee-0adaa27a3412 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:34.609458 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-27be19dd-7197-4cde-9aee-0adaa27a3412 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:34.617339 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-27be19dd-7197-4cde-9aee-0adaa27a3412 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.311431 Sep 03 01:33:34.617935 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 45/86] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:34 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:34.654519 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ce00409a-89f7-479f-a1e8-4efd8fbab1eb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:34.656244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ce00409a-89f7-479f-a1e8-4efd8fbab1eb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:34.676150 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ce00409a-89f7-479f-a1e8-4efd8fbab1eb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:34.676668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ce00409a-89f7-479f-a1e8-4efd8fbab1eb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:34.678143 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ce00409a-89f7-479f-a1e8-4efd8fbab1eb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:34.702579 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ce00409a-89f7-479f-a1e8-4efd8fbab1eb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:34.703169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ce00409a-89f7-479f-a1e8-4efd8fbab1eb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:34.703628 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ce00409a-89f7-479f-a1e8-4efd8fbab1eb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:34.889879 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-62b9f5c7-0a14-4841-8710-954105f666aa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:34.890107 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-62b9f5c7-0a14-4841-8710-954105f666aa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:34.896427 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62b9f5c7-0a14-4841-8710-954105f666aa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:34.900779 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62b9f5c7-0a14-4841-8710-954105f666aa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:34.901240 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62b9f5c7-0a14-4841-8710-954105f666aa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:34.901982 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62b9f5c7-0a14-4841-8710-954105f666aa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:34.902520 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62b9f5c7-0a14-4841-8710-954105f666aa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:34.902876 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62b9f5c7-0a14-4841-8710-954105f666aa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:35.119676 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ce00409a-89f7-479f-a1e8-4efd8fbab1eb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:35.127570 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ce00409a-89f7-479f-a1e8-4efd8fbab1eb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.477999 Sep 03 01:33:35.143581 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 42/87] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:34 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:35.143581 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-19a6ab15-f50e-44c4-8509-84c47ca26ce0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:35.143581 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-19a6ab15-f50e-44c4-8509-84c47ca26ce0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:35.148118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-19a6ab15-f50e-44c4-8509-84c47ca26ce0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:35.148706 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-19a6ab15-f50e-44c4-8509-84c47ca26ce0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:35.149146 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-19a6ab15-f50e-44c4-8509-84c47ca26ce0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:35.149959 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-19a6ab15-f50e-44c4-8509-84c47ca26ce0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:35.150381 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-19a6ab15-f50e-44c4-8509-84c47ca26ce0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:35.150820 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-19a6ab15-f50e-44c4-8509-84c47ca26ce0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:35.312033 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-19a6ab15-f50e-44c4-8509-84c47ca26ce0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:35.322546 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-19a6ab15-f50e-44c4-8509-84c47ca26ce0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.192995 Sep 03 01:33:35.334473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 43/88] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:35 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:35.334473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e16c2360-22d2-4b2a-b269-fb58bffdd674 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:35.334473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e16c2360-22d2-4b2a-b269-fb58bffdd674 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:35.341693 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e16c2360-22d2-4b2a-b269-fb58bffdd674 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:35.342260 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e16c2360-22d2-4b2a-b269-fb58bffdd674 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:35.342822 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e16c2360-22d2-4b2a-b269-fb58bffdd674 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:35.343601 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e16c2360-22d2-4b2a-b269-fb58bffdd674 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:35.344120 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e16c2360-22d2-4b2a-b269-fb58bffdd674 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:35.344614 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e16c2360-22d2-4b2a-b269-fb58bffdd674 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:35.375815 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-62b9f5c7-0a14-4841-8710-954105f666aa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:35.384755 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-62b9f5c7-0a14-4841-8710-954105f666aa tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.500815 Sep 03 01:33:35.385658 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 46/89] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:34 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:35.481641 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e16c2360-22d2-4b2a-b269-fb58bffdd674 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:35.490189 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e16c2360-22d2-4b2a-b269-fb58bffdd674 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:35.491692 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e16c2360-22d2-4b2a-b269-fb58bffdd674 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:35.493283 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e16c2360-22d2-4b2a-b269-fb58bffdd674 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.169100 Sep 03 01:33:35.494145 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 44/90] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:35 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:35.643859 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-68a4dfb6-1c0e-4727-9b85-93d494241c8d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:35.644465 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-68a4dfb6-1c0e-4727-9b85-93d494241c8d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:35.651306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68a4dfb6-1c0e-4727-9b85-93d494241c8d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:35.651777 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68a4dfb6-1c0e-4727-9b85-93d494241c8d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:35.652205 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68a4dfb6-1c0e-4727-9b85-93d494241c8d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:35.652882 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68a4dfb6-1c0e-4727-9b85-93d494241c8d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:35.653324 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68a4dfb6-1c0e-4727-9b85-93d494241c8d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:35.653736 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68a4dfb6-1c0e-4727-9b85-93d494241c8d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:35.919816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-68a4dfb6-1c0e-4727-9b85-93d494241c8d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:35.929227 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-68a4dfb6-1c0e-4727-9b85-93d494241c8d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.289185 Sep 03 01:33:35.929877 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 47/91] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:35 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:36.151412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3b289f10-afd7-4ef0-ab7b-13c9b823ff10 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:36.155563 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-3b289f10-afd7-4ef0-ab7b-13c9b823ff10 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:36.158415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3b289f10-afd7-4ef0-ab7b-13c9b823ff10 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:36.158896 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3b289f10-afd7-4ef0-ab7b-13c9b823ff10 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:36.159332 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3b289f10-afd7-4ef0-ab7b-13c9b823ff10 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:36.160013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3b289f10-afd7-4ef0-ab7b-13c9b823ff10 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:36.160464 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3b289f10-afd7-4ef0-ab7b-13c9b823ff10 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:36.160888 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3b289f10-afd7-4ef0-ab7b-13c9b823ff10 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:36.199299 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-533a61a4-62be-421a-92cf-0a408b92faba req-05cb544f-f91a-40f3-9be7-1eb41362947d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "329ea656-c337-4f07-bd3d-9f67c4d6418e", "tag": "8e331545-f680-453c-942e-5cd9fc274b5f"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:36.216810 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-533a61a4-62be-421a-92cf-0a408b92faba req-05cb544f-f91a-40f3-9be7-1eb41362947d service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:36.217362 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-533a61a4-62be-421a-92cf-0a408b92faba req-05cb544f-f91a-40f3-9be7-1eb41362947d service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:36.217861 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-533a61a4-62be-421a-92cf-0a408b92faba req-05cb544f-f91a-40f3-9be7-1eb41362947d service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:36.229263 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-533a61a4-62be-421a-92cf-0a408b92faba req-05cb544f-f91a-40f3-9be7-1eb41362947d service nova] Creating event network-changed:8e331545-f680-453c-942e-5cd9fc274b5f for instance 329ea656-c337-4f07-bd3d-9f67c4d6418e on hv-cinder-83800 Sep 03 01:33:36.234575 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-533a61a4-62be-421a-92cf-0a408b92faba req-05cb544f-f91a-40f3-9be7-1eb41362947d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039645 Sep 03 01:33:36.239116 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 48/92] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:36.306831 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3b289f10-afd7-4ef0-ab7b-13c9b823ff10 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:36.315224 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3b289f10-afd7-4ef0-ab7b-13c9b823ff10 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.167825 Sep 03 01:33:36.318081 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 45/93] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:36 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:36.347651 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-518aa5ab-a1d7-4cda-900c-198f54b5a854 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:36.348265 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-518aa5ab-a1d7-4cda-900c-198f54b5a854 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:36.355360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-518aa5ab-a1d7-4cda-900c-198f54b5a854 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:36.357854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-518aa5ab-a1d7-4cda-900c-198f54b5a854 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:36.357854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-518aa5ab-a1d7-4cda-900c-198f54b5a854 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:36.357854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-518aa5ab-a1d7-4cda-900c-198f54b5a854 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:36.357854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-518aa5ab-a1d7-4cda-900c-198f54b5a854 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:36.358247 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-518aa5ab-a1d7-4cda-900c-198f54b5a854 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:36.409236 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e65db95e-03c1-4738-a980-3bc3167d50ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:36.409843 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e65db95e-03c1-4738-a980-3bc3167d50ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:36.416128 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e65db95e-03c1-4738-a980-3bc3167d50ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:36.416608 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e65db95e-03c1-4738-a980-3bc3167d50ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:36.417044 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e65db95e-03c1-4738-a980-3bc3167d50ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:36.417763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e65db95e-03c1-4738-a980-3bc3167d50ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:36.418192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e65db95e-03c1-4738-a980-3bc3167d50ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:36.418645 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e65db95e-03c1-4738-a980-3bc3167d50ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:36.494020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-518aa5ab-a1d7-4cda-900c-198f54b5a854 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:36.501905 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-518aa5ab-a1d7-4cda-900c-198f54b5a854 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.158432 Sep 03 01:33:36.502657 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 49/94] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:36 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:36.522155 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2e225657-e302-48d1-826e-d2d26165a650 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:36.523461 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2e225657-e302-48d1-826e-d2d26165a650 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:36.529670 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e225657-e302-48d1-826e-d2d26165a650 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:36.530470 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e225657-e302-48d1-826e-d2d26165a650 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:36.530858 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e225657-e302-48d1-826e-d2d26165a650 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:36.531542 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e225657-e302-48d1-826e-d2d26165a650 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:36.532050 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e225657-e302-48d1-826e-d2d26165a650 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:36.532395 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e225657-e302-48d1-826e-d2d26165a650 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:36.550667 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e65db95e-03c1-4738-a980-3bc3167d50ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:36.559907 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e65db95e-03c1-4738-a980-3bc3167d50ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.154502 Sep 03 01:33:36.561472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 46/95] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:36 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:36.659695 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2e225657-e302-48d1-826e-d2d26165a650 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:36.667739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2e225657-e302-48d1-826e-d2d26165a650 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:36.669696 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2e225657-e302-48d1-826e-d2d26165a650 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:36.670291 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2e225657-e302-48d1-826e-d2d26165a650 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.152059 Sep 03 01:33:36.670874 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 50/96] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:36 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:36.956346 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-45e480cc-c421-416a-af1f-06abdf7044ac tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:36.956951 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-45e480cc-c421-416a-af1f-06abdf7044ac tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:36.963506 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-45e480cc-c421-416a-af1f-06abdf7044ac tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:36.963986 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-45e480cc-c421-416a-af1f-06abdf7044ac tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:36.964422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-45e480cc-c421-416a-af1f-06abdf7044ac tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:36.965106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-45e480cc-c421-416a-af1f-06abdf7044ac tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:36.965556 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-45e480cc-c421-416a-af1f-06abdf7044ac tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:36.965983 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-45e480cc-c421-416a-af1f-06abdf7044ac tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:37.111621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-45e480cc-c421-416a-af1f-06abdf7044ac tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:37.120801 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-45e480cc-c421-416a-af1f-06abdf7044ac tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.168341 Sep 03 01:33:37.121597 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 47/97] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:36 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:37.337759 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e700afe6-0221-4004-bc5f-b6a28340007e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:37.338413 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e700afe6-0221-4004-bc5f-b6a28340007e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:37.344326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e700afe6-0221-4004-bc5f-b6a28340007e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:37.344804 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e700afe6-0221-4004-bc5f-b6a28340007e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:37.345237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e700afe6-0221-4004-bc5f-b6a28340007e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:37.345917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e700afe6-0221-4004-bc5f-b6a28340007e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:37.346388 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e700afe6-0221-4004-bc5f-b6a28340007e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:37.346814 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e700afe6-0221-4004-bc5f-b6a28340007e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:37.479920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e700afe6-0221-4004-bc5f-b6a28340007e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:37.487413 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e700afe6-0221-4004-bc5f-b6a28340007e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.153514 Sep 03 01:33:37.487984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 51/98] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:37 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:37.525423 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a702b32b-16f5-4b75-8fbb-628bb3ce4b96 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:37.526039 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a702b32b-16f5-4b75-8fbb-628bb3ce4b96 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:37.532179 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a702b32b-16f5-4b75-8fbb-628bb3ce4b96 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:37.532663 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a702b32b-16f5-4b75-8fbb-628bb3ce4b96 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:37.533100 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a702b32b-16f5-4b75-8fbb-628bb3ce4b96 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:37.533788 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a702b32b-16f5-4b75-8fbb-628bb3ce4b96 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:37.534243 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a702b32b-16f5-4b75-8fbb-628bb3ce4b96 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:37.534703 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a702b32b-16f5-4b75-8fbb-628bb3ce4b96 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:37.583180 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b7aafb69-b662-495e-a8cc-dfe219f10653 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:37.583785 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b7aafb69-b662-495e-a8cc-dfe219f10653 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:37.590468 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b7aafb69-b662-495e-a8cc-dfe219f10653 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:37.590882 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b7aafb69-b662-495e-a8cc-dfe219f10653 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:37.591318 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b7aafb69-b662-495e-a8cc-dfe219f10653 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:37.592008 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b7aafb69-b662-495e-a8cc-dfe219f10653 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:37.592460 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b7aafb69-b662-495e-a8cc-dfe219f10653 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:37.592911 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b7aafb69-b662-495e-a8cc-dfe219f10653 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:37.611747 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=100 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:37.666279 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a702b32b-16f5-4b75-8fbb-628bb3ce4b96 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:37.674008 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a702b32b-16f5-4b75-8fbb-628bb3ce4b96 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.152967 Sep 03 01:33:37.674608 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 48/99] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:37 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:37.695476 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f5f8289b-5c5d-424e-a5ec-c9631ec607b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:37.696081 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f5f8289b-5c5d-424e-a5ec-c9631ec607b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:37.702023 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f5f8289b-5c5d-424e-a5ec-c9631ec607b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:37.702578 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f5f8289b-5c5d-424e-a5ec-c9631ec607b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:37.703014 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f5f8289b-5c5d-424e-a5ec-c9631ec607b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:37.703702 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f5f8289b-5c5d-424e-a5ec-c9631ec607b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:37.704154 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f5f8289b-5c5d-424e-a5ec-c9631ec607b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:37.704579 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f5f8289b-5c5d-424e-a5ec-c9631ec607b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:37.721002 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b7aafb69-b662-495e-a8cc-dfe219f10653 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:37.729118 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b7aafb69-b662-495e-a8cc-dfe219f10653 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.149740 Sep 03 01:33:37.729682 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 52/100] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:37 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:37.832615 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f5f8289b-5c5d-424e-a5ec-c9631ec607b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:37.841147 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f5f8289b-5c5d-424e-a5ec-c9631ec607b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:37.842558 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f5f8289b-5c5d-424e-a5ec-c9631ec607b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:37.843659 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f5f8289b-5c5d-424e-a5ec-c9631ec607b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.152019 Sep 03 01:33:37.844219 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 49/101] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:37 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:38.144846 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-22287647-2ee7-47a6-9d1d-a85ca3dd919f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:38.145577 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-22287647-2ee7-47a6-9d1d-a85ca3dd919f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:38.152819 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-22287647-2ee7-47a6-9d1d-a85ca3dd919f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:38.154263 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-22287647-2ee7-47a6-9d1d-a85ca3dd919f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:38.154754 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-22287647-2ee7-47a6-9d1d-a85ca3dd919f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:38.155795 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-22287647-2ee7-47a6-9d1d-a85ca3dd919f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:38.156255 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-22287647-2ee7-47a6-9d1d-a85ca3dd919f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:38.156780 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-22287647-2ee7-47a6-9d1d-a85ca3dd919f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:38.252367 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-cd65e1d0-462f-4914-9492-6aaf9aa71327 req-43b47dd1-451f-42d9-8f91-518fe44c0422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fef20f-3dfd-4d65-b5ed-50f3caaa011f", "tag": "e8b8b19d-91b5-4b5a-a71d-5c995462d419"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:38.262631 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-cd65e1d0-462f-4914-9492-6aaf9aa71327 req-43b47dd1-451f-42d9-8f91-518fe44c0422 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:38.263109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-cd65e1d0-462f-4914-9492-6aaf9aa71327 req-43b47dd1-451f-42d9-8f91-518fe44c0422 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:38.263539 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-cd65e1d0-462f-4914-9492-6aaf9aa71327 req-43b47dd1-451f-42d9-8f91-518fe44c0422 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:38.274536 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-cd65e1d0-462f-4914-9492-6aaf9aa71327 req-43b47dd1-451f-42d9-8f91-518fe44c0422 service nova] Creating event network-changed:e8b8b19d-91b5-4b5a-a71d-5c995462d419 for instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f on hv-cinder-83800 Sep 03 01:33:38.279540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-cd65e1d0-462f-4914-9492-6aaf9aa71327 req-43b47dd1-451f-42d9-8f91-518fe44c0422 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030800 Sep 03 01:33:38.280441 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 50/102] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:33:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:33:38.295333 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-22287647-2ee7-47a6-9d1d-a85ca3dd919f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:38.303248 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-22287647-2ee7-47a6-9d1d-a85ca3dd919f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.162275 Sep 03 01:33:38.303719 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 53/103] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:38 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:38.511576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d2aeaac1-b47b-4760-9134-ada38551ea53 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:38.512263 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d2aeaac1-b47b-4760-9134-ada38551ea53 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:38.518644 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d2aeaac1-b47b-4760-9134-ada38551ea53 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:38.519141 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d2aeaac1-b47b-4760-9134-ada38551ea53 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:38.519634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d2aeaac1-b47b-4760-9134-ada38551ea53 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:38.520326 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d2aeaac1-b47b-4760-9134-ada38551ea53 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:38.520778 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d2aeaac1-b47b-4760-9134-ada38551ea53 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:38.521205 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d2aeaac1-b47b-4760-9134-ada38551ea53 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:38.654689 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d2aeaac1-b47b-4760-9134-ada38551ea53 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:38.662681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d2aeaac1-b47b-4760-9134-ada38551ea53 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.156045 Sep 03 01:33:38.663198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 51/104] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:38 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:38.697676 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-df131324-73f7-4690-baa9-fbb1311992d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:38.698304 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-df131324-73f7-4690-baa9-fbb1311992d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:38.706975 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-df131324-73f7-4690-baa9-fbb1311992d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:38.707839 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-df131324-73f7-4690-baa9-fbb1311992d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:38.708669 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-df131324-73f7-4690-baa9-fbb1311992d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:38.709947 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-df131324-73f7-4690-baa9-fbb1311992d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:38.711446 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-df131324-73f7-4690-baa9-fbb1311992d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:38.712198 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-df131324-73f7-4690-baa9-fbb1311992d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:38.752079 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d7ec27e7-aceb-4591-b3a6-c594f3fbbc36 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:38.752719 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d7ec27e7-aceb-4591-b3a6-c594f3fbbc36 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:38.759290 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d7ec27e7-aceb-4591-b3a6-c594f3fbbc36 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:38.759773 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d7ec27e7-aceb-4591-b3a6-c594f3fbbc36 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:38.760216 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d7ec27e7-aceb-4591-b3a6-c594f3fbbc36 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:38.760906 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d7ec27e7-aceb-4591-b3a6-c594f3fbbc36 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:38.761355 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d7ec27e7-aceb-4591-b3a6-c594f3fbbc36 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:38.761779 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d7ec27e7-aceb-4591-b3a6-c594f3fbbc36 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:38.842428 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-df131324-73f7-4690-baa9-fbb1311992d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:38.850215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-df131324-73f7-4690-baa9-fbb1311992d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.157162 Sep 03 01:33:38.851141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 54/105] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:38 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:38.868939 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cefd9433-6a83-4ca1-a0b5-b45c166c91d8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:38.869545 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-cefd9433-6a83-4ca1-a0b5-b45c166c91d8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:38.875609 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cefd9433-6a83-4ca1-a0b5-b45c166c91d8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:38.876105 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cefd9433-6a83-4ca1-a0b5-b45c166c91d8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:38.876546 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cefd9433-6a83-4ca1-a0b5-b45c166c91d8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:38.877250 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cefd9433-6a83-4ca1-a0b5-b45c166c91d8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:38.877705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cefd9433-6a83-4ca1-a0b5-b45c166c91d8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:38.878127 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cefd9433-6a83-4ca1-a0b5-b45c166c91d8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:38.901490 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d7ec27e7-aceb-4591-b3a6-c594f3fbbc36 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:38.910760 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d7ec27e7-aceb-4591-b3a6-c594f3fbbc36 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.162859 Sep 03 01:33:38.911345 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 52/106] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:38 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:39.016471 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cefd9433-6a83-4ca1-a0b5-b45c166c91d8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:39.025237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cefd9433-6a83-4ca1-a0b5-b45c166c91d8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:39.026767 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cefd9433-6a83-4ca1-a0b5-b45c166c91d8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:39.027760 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-cefd9433-6a83-4ca1-a0b5-b45c166c91d8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.162727 Sep 03 01:33:39.028310 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 55/107] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:38 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:39.362465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-44289334-8bed-48be-8ad5-20582a85819e tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:39.362465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-44289334-8bed-48be-8ad5-20582a85819e tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:39.362465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=10 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:39.362465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-44289334-8bed-48be-8ad5-20582a85819e tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:39.362465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-44289334-8bed-48be-8ad5-20582a85819e tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:39.363085 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-44289334-8bed-48be-8ad5-20582a85819e tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:39.363085 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-44289334-8bed-48be-8ad5-20582a85819e tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:39.363085 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-44289334-8bed-48be-8ad5-20582a85819e tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:39.363085 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-44289334-8bed-48be-8ad5-20582a85819e tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:39.371362 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:39.685654 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6229bd3c-936a-42d8-8298-4a48a4549c4f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:39.686270 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6229bd3c-936a-42d8-8298-4a48a4549c4f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:39.692580 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6229bd3c-936a-42d8-8298-4a48a4549c4f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:39.693280 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6229bd3c-936a-42d8-8298-4a48a4549c4f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:39.693871 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6229bd3c-936a-42d8-8298-4a48a4549c4f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:39.695340 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6229bd3c-936a-42d8-8298-4a48a4549c4f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:39.696167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6229bd3c-936a-42d8-8298-4a48a4549c4f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:39.696754 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6229bd3c-936a-42d8-8298-4a48a4549c4f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:39.748531 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-44289334-8bed-48be-8ad5-20582a85819e tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:39.759647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-44289334-8bed-48be-8ad5-20582a85819e tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.438163 Sep 03 01:33:39.761654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 53/108] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:39 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:39.874496 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6f4ac556-e7a8-418e-b4bf-8f98db7b9870 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:39.875391 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6f4ac556-e7a8-418e-b4bf-8f98db7b9870 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:39.882920 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f4ac556-e7a8-418e-b4bf-8f98db7b9870 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:39.883693 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f4ac556-e7a8-418e-b4bf-8f98db7b9870 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:39.884299 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f4ac556-e7a8-418e-b4bf-8f98db7b9870 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:39.885164 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f4ac556-e7a8-418e-b4bf-8f98db7b9870 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:39.886271 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f4ac556-e7a8-418e-b4bf-8f98db7b9870 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:39.886888 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f4ac556-e7a8-418e-b4bf-8f98db7b9870 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:39.890269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6229bd3c-936a-42d8-8298-4a48a4549c4f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:39.899764 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6229bd3c-936a-42d8-8298-4a48a4549c4f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.217778 Sep 03 01:33:39.900999 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 56/109] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:39 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:39.934438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b3cf6280-6157-40d6-bbba-1c80a2b7f3a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:39.935117 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b3cf6280-6157-40d6-bbba-1c80a2b7f3a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:39.941206 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b3cf6280-6157-40d6-bbba-1c80a2b7f3a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:39.941684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b3cf6280-6157-40d6-bbba-1c80a2b7f3a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:39.942115 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b3cf6280-6157-40d6-bbba-1c80a2b7f3a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:39.942907 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b3cf6280-6157-40d6-bbba-1c80a2b7f3a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:39.943408 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b3cf6280-6157-40d6-bbba-1c80a2b7f3a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:39.943852 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b3cf6280-6157-40d6-bbba-1c80a2b7f3a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:40.092391 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b3cf6280-6157-40d6-bbba-1c80a2b7f3a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:40.103099 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b3cf6280-6157-40d6-bbba-1c80a2b7f3a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.172289 Sep 03 01:33:40.103391 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 57/110] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:39 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:40.109657 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6f4ac556-e7a8-418e-b4bf-8f98db7b9870 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:40.118265 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6f4ac556-e7a8-418e-b4bf-8f98db7b9870 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.248302 Sep 03 01:33:40.118958 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 54/111] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:39 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:40.123481 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d88d0af2-0deb-4146-b875-d7dc5c034b44 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:40.124171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d88d0af2-0deb-4146-b875-d7dc5c034b44 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:40.130413 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d88d0af2-0deb-4146-b875-d7dc5c034b44 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:40.130952 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d88d0af2-0deb-4146-b875-d7dc5c034b44 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:40.131373 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d88d0af2-0deb-4146-b875-d7dc5c034b44 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:40.132183 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d88d0af2-0deb-4146-b875-d7dc5c034b44 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:40.133053 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d88d0af2-0deb-4146-b875-d7dc5c034b44 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:40.133511 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d88d0af2-0deb-4146-b875-d7dc5c034b44 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:40.282257 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d88d0af2-0deb-4146-b875-d7dc5c034b44 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:40.291689 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d88d0af2-0deb-4146-b875-d7dc5c034b44 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:40.293168 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d88d0af2-0deb-4146-b875-d7dc5c034b44 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:40.294507 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d88d0af2-0deb-4146-b875-d7dc5c034b44 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.174784 Sep 03 01:33:40.295262 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 58/112] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:40 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:40.541240 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-b1233f12-5886-4243-a27d-442d3b01b31d req-5272cb01-70ca-482e-a165-e4a6e1c2d324 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb", "tag": "fc3e436d-fb1a-441d-bc04-3d6a3d3a5bc4"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:40.557153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-b1233f12-5886-4243-a27d-442d3b01b31d req-5272cb01-70ca-482e-a165-e4a6e1c2d324 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:40.557632 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-b1233f12-5886-4243-a27d-442d3b01b31d req-5272cb01-70ca-482e-a165-e4a6e1c2d324 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:40.558057 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-b1233f12-5886-4243-a27d-442d3b01b31d req-5272cb01-70ca-482e-a165-e4a6e1c2d324 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:40.570065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-b1233f12-5886-4243-a27d-442d3b01b31d req-5272cb01-70ca-482e-a165-e4a6e1c2d324 service nova] Creating event network-changed:fc3e436d-fb1a-441d-bc04-3d6a3d3a5bc4 for instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb on hv-cinder-83800 Sep 03 01:33:40.576624 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-b1233f12-5886-4243-a27d-442d3b01b31d req-5272cb01-70ca-482e-a165-e4a6e1c2d324 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039559 Sep 03 01:33:40.578609 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 55/113] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:40.783806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8807ae3a-79f3-47f6-9cb9-32cfd3dbbf06 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:40.784344 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8807ae3a-79f3-47f6-9cb9-32cfd3dbbf06 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:40.791251 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8807ae3a-79f3-47f6-9cb9-32cfd3dbbf06 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:40.791770 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8807ae3a-79f3-47f6-9cb9-32cfd3dbbf06 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:40.792205 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8807ae3a-79f3-47f6-9cb9-32cfd3dbbf06 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:40.792887 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8807ae3a-79f3-47f6-9cb9-32cfd3dbbf06 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:40.793333 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8807ae3a-79f3-47f6-9cb9-32cfd3dbbf06 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:40.796354 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8807ae3a-79f3-47f6-9cb9-32cfd3dbbf06 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:40.923943 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d92e5d2d-7ac1-4a17-86d9-8cd231a607d6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:40.924720 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d92e5d2d-7ac1-4a17-86d9-8cd231a607d6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:40.926430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8807ae3a-79f3-47f6-9cb9-32cfd3dbbf06 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:40.933119 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d92e5d2d-7ac1-4a17-86d9-8cd231a607d6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:40.933796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d92e5d2d-7ac1-4a17-86d9-8cd231a607d6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:40.934240 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d92e5d2d-7ac1-4a17-86d9-8cd231a607d6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:40.934938 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d92e5d2d-7ac1-4a17-86d9-8cd231a607d6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:40.935449 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d92e5d2d-7ac1-4a17-86d9-8cd231a607d6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:40.935850 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8807ae3a-79f3-47f6-9cb9-32cfd3dbbf06 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.156239 Sep 03 01:33:40.935957 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d92e5d2d-7ac1-4a17-86d9-8cd231a607d6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:40.936589 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 59/114] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:40 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:41.089764 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d92e5d2d-7ac1-4a17-86d9-8cd231a607d6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:41.099344 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d92e5d2d-7ac1-4a17-86d9-8cd231a607d6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.179042 Sep 03 01:33:41.099673 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 56/115] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:40 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:41.128638 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bb9e08d2-1c1c-43fa-8bdd-82eea435811d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:41.129503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bb9e08d2-1c1c-43fa-8bdd-82eea435811d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:41.141979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bb9e08d2-1c1c-43fa-8bdd-82eea435811d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:41.144033 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-34e04a3d-9f3d-4b20-9c9a-1dda8ba3df8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:41.144708 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bb9e08d2-1c1c-43fa-8bdd-82eea435811d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:41.145218 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bb9e08d2-1c1c-43fa-8bdd-82eea435811d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:41.147018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bb9e08d2-1c1c-43fa-8bdd-82eea435811d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:41.147018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bb9e08d2-1c1c-43fa-8bdd-82eea435811d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:41.147018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bb9e08d2-1c1c-43fa-8bdd-82eea435811d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:41.148367 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-34e04a3d-9f3d-4b20-9c9a-1dda8ba3df8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:41.164060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-34e04a3d-9f3d-4b20-9c9a-1dda8ba3df8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:41.165231 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-34e04a3d-9f3d-4b20-9c9a-1dda8ba3df8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:41.165868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-34e04a3d-9f3d-4b20-9c9a-1dda8ba3df8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:41.167197 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-34e04a3d-9f3d-4b20-9c9a-1dda8ba3df8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:41.168532 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-34e04a3d-9f3d-4b20-9c9a-1dda8ba3df8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:41.169446 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-34e04a3d-9f3d-4b20-9c9a-1dda8ba3df8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:41.599719 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bb9e08d2-1c1c-43fa-8bdd-82eea435811d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:41.608558 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bb9e08d2-1c1c-43fa-8bdd-82eea435811d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.485108 Sep 03 01:33:41.614123 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 60/116] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:41 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:41.620670 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a19f7f0d-681e-4f91-afd4-f4fd9e6d082c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:41.621368 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a19f7f0d-681e-4f91-afd4-f4fd9e6d082c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:41.628892 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a19f7f0d-681e-4f91-afd4-f4fd9e6d082c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:41.629470 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a19f7f0d-681e-4f91-afd4-f4fd9e6d082c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:41.629967 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a19f7f0d-681e-4f91-afd4-f4fd9e6d082c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:41.630753 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a19f7f0d-681e-4f91-afd4-f4fd9e6d082c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:41.631290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a19f7f0d-681e-4f91-afd4-f4fd9e6d082c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:41.631795 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a19f7f0d-681e-4f91-afd4-f4fd9e6d082c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:41.709956 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-34e04a3d-9f3d-4b20-9c9a-1dda8ba3df8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:41.719441 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-34e04a3d-9f3d-4b20-9c9a-1dda8ba3df8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.579717 Sep 03 01:33:41.720609 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 57/117] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:41 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:41.769888 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a19f7f0d-681e-4f91-afd4-f4fd9e6d082c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:41.779234 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a19f7f0d-681e-4f91-afd4-f4fd9e6d082c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:41.780913 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a19f7f0d-681e-4f91-afd4-f4fd9e6d082c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:41.782007 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a19f7f0d-681e-4f91-afd4-f4fd9e6d082c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.166498 Sep 03 01:33:41.782586 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 61/118] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:41 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:41.961547 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cd1634d5-b6c2-48a5-8da2-4048cb46d3e4 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:41.962177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cd1634d5-b6c2-48a5-8da2-4048cb46d3e4 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:41.968041 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd1634d5-b6c2-48a5-8da2-4048cb46d3e4 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:41.968515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd1634d5-b6c2-48a5-8da2-4048cb46d3e4 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:41.968944 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd1634d5-b6c2-48a5-8da2-4048cb46d3e4 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:41.969615 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd1634d5-b6c2-48a5-8da2-4048cb46d3e4 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:41.970056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd1634d5-b6c2-48a5-8da2-4048cb46d3e4 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:41.970503 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd1634d5-b6c2-48a5-8da2-4048cb46d3e4 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:42.105198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cd1634d5-b6c2-48a5-8da2-4048cb46d3e4 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:42.113274 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cd1634d5-b6c2-48a5-8da2-4048cb46d3e4 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.156393 Sep 03 01:33:42.113841 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 58/119] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:41 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:42.122062 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bd798953-402d-483c-9840-3e8f2502a39b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:42.122647 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bd798953-402d-483c-9840-3e8f2502a39b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:42.128849 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd798953-402d-483c-9840-3e8f2502a39b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:42.129357 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd798953-402d-483c-9840-3e8f2502a39b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:42.129783 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd798953-402d-483c-9840-3e8f2502a39b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:42.130544 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd798953-402d-483c-9840-3e8f2502a39b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:42.130990 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd798953-402d-483c-9840-3e8f2502a39b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:42.131439 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd798953-402d-483c-9840-3e8f2502a39b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:42.260191 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bd798953-402d-483c-9840-3e8f2502a39b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:42.267677 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bd798953-402d-483c-9840-3e8f2502a39b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.149754 Sep 03 01:33:42.268237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 62/120] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:42 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:42.631489 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f7e4fd66-0565-42e3-a4d2-e6df484b39b1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:42.632120 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f7e4fd66-0565-42e3-a4d2-e6df484b39b1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:42.638140 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7e4fd66-0565-42e3-a4d2-e6df484b39b1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:42.638648 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7e4fd66-0565-42e3-a4d2-e6df484b39b1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:42.639081 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7e4fd66-0565-42e3-a4d2-e6df484b39b1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:42.639756 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7e4fd66-0565-42e3-a4d2-e6df484b39b1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:42.640200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7e4fd66-0565-42e3-a4d2-e6df484b39b1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:42.640618 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7e4fd66-0565-42e3-a4d2-e6df484b39b1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:42.744604 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2c79fb10-2ebc-4701-ae1a-02105495a1fa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:42.745214 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2c79fb10-2ebc-4701-ae1a-02105495a1fa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:42.751297 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c79fb10-2ebc-4701-ae1a-02105495a1fa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:42.751942 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c79fb10-2ebc-4701-ae1a-02105495a1fa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:42.752680 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c79fb10-2ebc-4701-ae1a-02105495a1fa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:42.753873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c79fb10-2ebc-4701-ae1a-02105495a1fa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:42.754721 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c79fb10-2ebc-4701-ae1a-02105495a1fa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:42.755503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c79fb10-2ebc-4701-ae1a-02105495a1fa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:42.774269 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f7e4fd66-0565-42e3-a4d2-e6df484b39b1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:42.782410 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f7e4fd66-0565-42e3-a4d2-e6df484b39b1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.154776 Sep 03 01:33:42.782990 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 59/121] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:42 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:42.809424 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-67dea693-ebe8-4e0a-a69d-1cdc02d4b5b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:42.810093 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-67dea693-ebe8-4e0a-a69d-1cdc02d4b5b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:42.816310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-67dea693-ebe8-4e0a-a69d-1cdc02d4b5b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:42.816855 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-67dea693-ebe8-4e0a-a69d-1cdc02d4b5b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:42.817292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-67dea693-ebe8-4e0a-a69d-1cdc02d4b5b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:42.818020 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-67dea693-ebe8-4e0a-a69d-1cdc02d4b5b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:42.818528 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-67dea693-ebe8-4e0a-a69d-1cdc02d4b5b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:42.818945 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-67dea693-ebe8-4e0a-a69d-1cdc02d4b5b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:42.892774 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2c79fb10-2ebc-4701-ae1a-02105495a1fa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:42.902756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2c79fb10-2ebc-4701-ae1a-02105495a1fa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.163119 Sep 03 01:33:42.903641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 63/122] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:42 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:42.955617 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-67dea693-ebe8-4e0a-a69d-1cdc02d4b5b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:42.965834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-67dea693-ebe8-4e0a-a69d-1cdc02d4b5b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:42.966415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-67dea693-ebe8-4e0a-a69d-1cdc02d4b5b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:42.967487 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-67dea693-ebe8-4e0a-a69d-1cdc02d4b5b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.163766 Sep 03 01:33:42.968051 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 60/123] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:42 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:43.137628 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4f546818-ae9f-48e5-8814-fc5d330c1125 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:43.138371 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4f546818-ae9f-48e5-8814-fc5d330c1125 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:43.144287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f546818-ae9f-48e5-8814-fc5d330c1125 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:43.144762 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f546818-ae9f-48e5-8814-fc5d330c1125 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:43.145190 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f546818-ae9f-48e5-8814-fc5d330c1125 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:43.145891 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f546818-ae9f-48e5-8814-fc5d330c1125 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:43.146344 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f546818-ae9f-48e5-8814-fc5d330c1125 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:43.146777 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f546818-ae9f-48e5-8814-fc5d330c1125 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:43.281633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4f546818-ae9f-48e5-8814-fc5d330c1125 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:43.289339 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4f546818-ae9f-48e5-8814-fc5d330c1125 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.155681 Sep 03 01:33:43.289896 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 64/124] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:43 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:43.290913 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-175301c7-ab00-4692-bd50-f6bce245ca9b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:43.291531 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-175301c7-ab00-4692-bd50-f6bce245ca9b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:43.298136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-175301c7-ab00-4692-bd50-f6bce245ca9b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:43.298658 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-175301c7-ab00-4692-bd50-f6bce245ca9b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:43.299257 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-175301c7-ab00-4692-bd50-f6bce245ca9b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:43.300089 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-175301c7-ab00-4692-bd50-f6bce245ca9b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:43.300647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-175301c7-ab00-4692-bd50-f6bce245ca9b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:43.301079 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-175301c7-ab00-4692-bd50-f6bce245ca9b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:43.434751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-175301c7-ab00-4692-bd50-f6bce245ca9b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:43.442542 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-175301c7-ab00-4692-bd50-f6bce245ca9b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.155591 Sep 03 01:33:43.443205 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 61/125] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:43 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:43.805381 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-91807f97-2002-4369-a6a7-80bc49156809 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:43.806583 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-91807f97-2002-4369-a6a7-80bc49156809 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:43.812058 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-91807f97-2002-4369-a6a7-80bc49156809 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:43.812529 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-91807f97-2002-4369-a6a7-80bc49156809 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:43.812953 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-91807f97-2002-4369-a6a7-80bc49156809 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:43.813622 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-91807f97-2002-4369-a6a7-80bc49156809 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:43.814064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-91807f97-2002-4369-a6a7-80bc49156809 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:43.814523 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-91807f97-2002-4369-a6a7-80bc49156809 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:43.927859 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a0b00694-1f1b-4aae-8641-60defa954986 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:43.930682 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a0b00694-1f1b-4aae-8641-60defa954986 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:43.935479 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0b00694-1f1b-4aae-8641-60defa954986 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:43.936034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0b00694-1f1b-4aae-8641-60defa954986 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:43.936466 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0b00694-1f1b-4aae-8641-60defa954986 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:43.937301 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0b00694-1f1b-4aae-8641-60defa954986 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:43.937753 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0b00694-1f1b-4aae-8641-60defa954986 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:43.938176 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0b00694-1f1b-4aae-8641-60defa954986 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:43.948138 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-91807f97-2002-4369-a6a7-80bc49156809 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:43.956743 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-91807f97-2002-4369-a6a7-80bc49156809 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.155316 Sep 03 01:33:43.957641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 65/126] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:43 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:43.998308 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-81809b4b-dbc7-4f3d-b357-5e54c3897542 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:43.999156 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-81809b4b-dbc7-4f3d-b357-5e54c3897542 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:44.007121 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81809b4b-dbc7-4f3d-b357-5e54c3897542 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:44.007395 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81809b4b-dbc7-4f3d-b357-5e54c3897542 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:44.007932 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81809b4b-dbc7-4f3d-b357-5e54c3897542 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:44.009165 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81809b4b-dbc7-4f3d-b357-5e54c3897542 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:44.009733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81809b4b-dbc7-4f3d-b357-5e54c3897542 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:44.010780 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81809b4b-dbc7-4f3d-b357-5e54c3897542 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:44.085835 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a0b00694-1f1b-4aae-8641-60defa954986 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:44.094388 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a0b00694-1f1b-4aae-8641-60defa954986 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.170458 Sep 03 01:33:44.096994 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 62/127] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:43 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:44.157933 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-81809b4b-dbc7-4f3d-b357-5e54c3897542 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:44.165851 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-81809b4b-dbc7-4f3d-b357-5e54c3897542 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:44.167440 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-81809b4b-dbc7-4f3d-b357-5e54c3897542 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:44.168827 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-81809b4b-dbc7-4f3d-b357-5e54c3897542 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.174686 Sep 03 01:33:44.179642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 66/128] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:43 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:44.317110 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a35c6fea-c68d-4352-975b-27cf56dd5482 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:44.318704 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a35c6fea-c68d-4352-975b-27cf56dd5482 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:44.328637 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a35c6fea-c68d-4352-975b-27cf56dd5482 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:44.329262 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a35c6fea-c68d-4352-975b-27cf56dd5482 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:44.330034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a35c6fea-c68d-4352-975b-27cf56dd5482 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:44.330843 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a35c6fea-c68d-4352-975b-27cf56dd5482 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:44.331364 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a35c6fea-c68d-4352-975b-27cf56dd5482 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:44.332048 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a35c6fea-c68d-4352-975b-27cf56dd5482 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:44.469572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a646fa12-4131-4151-8c9e-51c7c450d3b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:44.470377 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a646fa12-4131-4151-8c9e-51c7c450d3b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:44.477365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a646fa12-4131-4151-8c9e-51c7c450d3b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:44.478161 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a646fa12-4131-4151-8c9e-51c7c450d3b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:44.478923 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a646fa12-4131-4151-8c9e-51c7c450d3b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:44.479893 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a646fa12-4131-4151-8c9e-51c7c450d3b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:44.480447 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a646fa12-4131-4151-8c9e-51c7c450d3b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:44.480950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a646fa12-4131-4151-8c9e-51c7c450d3b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:44.635363 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a646fa12-4131-4151-8c9e-51c7c450d3b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:44.643474 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a646fa12-4131-4151-8c9e-51c7c450d3b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.179791 Sep 03 01:33:44.644373 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 67/129] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:44 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:44.651085 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a35c6fea-c68d-4352-975b-27cf56dd5482 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:44.659258 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a35c6fea-c68d-4352-975b-27cf56dd5482 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.347708 Sep 03 01:33:44.660151 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 63/130] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:44 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:44.979997 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cb18577e-a8a5-4f40-9b44-9f56a09a20f2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:44.980607 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-cb18577e-a8a5-4f40-9b44-9f56a09a20f2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:44.987302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb18577e-a8a5-4f40-9b44-9f56a09a20f2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:44.992710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb18577e-a8a5-4f40-9b44-9f56a09a20f2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:44.992710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb18577e-a8a5-4f40-9b44-9f56a09a20f2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:44.992710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb18577e-a8a5-4f40-9b44-9f56a09a20f2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:44.992710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb18577e-a8a5-4f40-9b44-9f56a09a20f2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:44.993083 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb18577e-a8a5-4f40-9b44-9f56a09a20f2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:45.119728 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-63cd73f5-7f26-4de5-88df-fd6c03fae4b4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:45.120243 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-63cd73f5-7f26-4de5-88df-fd6c03fae4b4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:45.126415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63cd73f5-7f26-4de5-88df-fd6c03fae4b4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:45.126908 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63cd73f5-7f26-4de5-88df-fd6c03fae4b4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:45.127343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63cd73f5-7f26-4de5-88df-fd6c03fae4b4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:45.128142 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63cd73f5-7f26-4de5-88df-fd6c03fae4b4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:45.128473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63cd73f5-7f26-4de5-88df-fd6c03fae4b4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:45.128892 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63cd73f5-7f26-4de5-88df-fd6c03fae4b4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:45.131444 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cb18577e-a8a5-4f40-9b44-9f56a09a20f2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:45.139626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-cb18577e-a8a5-4f40-9b44-9f56a09a20f2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.164206 Sep 03 01:33:45.140330 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 68/131] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:44 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:45.197972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e22d355f-73a6-4f9a-ab29-0e7d31213af9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:45.200186 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e22d355f-73a6-4f9a-ab29-0e7d31213af9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:45.207788 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e22d355f-73a6-4f9a-ab29-0e7d31213af9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:45.208588 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e22d355f-73a6-4f9a-ab29-0e7d31213af9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:45.209251 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e22d355f-73a6-4f9a-ab29-0e7d31213af9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:45.210674 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e22d355f-73a6-4f9a-ab29-0e7d31213af9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:45.211827 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e22d355f-73a6-4f9a-ab29-0e7d31213af9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:45.212417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e22d355f-73a6-4f9a-ab29-0e7d31213af9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:45.219861 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=100 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:45.317545 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-63cd73f5-7f26-4de5-88df-fd6c03fae4b4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:45.330280 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-63cd73f5-7f26-4de5-88df-fd6c03fae4b4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.214743 Sep 03 01:33:45.331718 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 64/132] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:45 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:45.412335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e22d355f-73a6-4f9a-ab29-0e7d31213af9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:45.424206 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e22d355f-73a6-4f9a-ab29-0e7d31213af9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:45.425982 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e22d355f-73a6-4f9a-ab29-0e7d31213af9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:45.427739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e22d355f-73a6-4f9a-ab29-0e7d31213af9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.235349 Sep 03 01:33:45.438800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 69/133] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:45 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:45.674298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c00c344e-ff5f-462e-98c3-9c7ace5fe510 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:45.674925 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c00c344e-ff5f-462e-98c3-9c7ace5fe510 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:45.681740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c00c344e-ff5f-462e-98c3-9c7ace5fe510 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:45.682229 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c00c344e-ff5f-462e-98c3-9c7ace5fe510 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:45.682754 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c00c344e-ff5f-462e-98c3-9c7ace5fe510 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:45.682877 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bd151047-6e5e-43ee-aea5-3f9873f54f9f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:45.683416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bd151047-6e5e-43ee-aea5-3f9873f54f9f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:45.683530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c00c344e-ff5f-462e-98c3-9c7ace5fe510 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:45.683916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c00c344e-ff5f-462e-98c3-9c7ace5fe510 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:45.684341 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c00c344e-ff5f-462e-98c3-9c7ace5fe510 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:45.689456 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd151047-6e5e-43ee-aea5-3f9873f54f9f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:45.691358 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd151047-6e5e-43ee-aea5-3f9873f54f9f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:45.691358 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd151047-6e5e-43ee-aea5-3f9873f54f9f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:45.691358 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd151047-6e5e-43ee-aea5-3f9873f54f9f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:45.691608 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd151047-6e5e-43ee-aea5-3f9873f54f9f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:45.691956 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd151047-6e5e-43ee-aea5-3f9873f54f9f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:45.823018 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c00c344e-ff5f-462e-98c3-9c7ace5fe510 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:45.824038 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bd151047-6e5e-43ee-aea5-3f9873f54f9f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:45.831680 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c00c344e-ff5f-462e-98c3-9c7ace5fe510 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.161175 Sep 03 01:33:45.832192 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bd151047-6e5e-43ee-aea5-3f9873f54f9f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.153807 Sep 03 01:33:45.832584 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 65/134] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:45 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:45.834531 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 70/135] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:45 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:46.169329 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ef715c03-c9c9-4d8a-8c0d-14cadb6ad6ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:46.169936 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ef715c03-c9c9-4d8a-8c0d-14cadb6ad6ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:46.176034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef715c03-c9c9-4d8a-8c0d-14cadb6ad6ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:46.176655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef715c03-c9c9-4d8a-8c0d-14cadb6ad6ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:46.177137 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef715c03-c9c9-4d8a-8c0d-14cadb6ad6ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:46.177849 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef715c03-c9c9-4d8a-8c0d-14cadb6ad6ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:46.178305 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef715c03-c9c9-4d8a-8c0d-14cadb6ad6ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:46.178824 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef715c03-c9c9-4d8a-8c0d-14cadb6ad6ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:46.345447 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ef715c03-c9c9-4d8a-8c0d-14cadb6ad6ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:46.353945 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e549ab0b-e08a-4511-8992-40c0d9a28643 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:46.354510 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ef715c03-c9c9-4d8a-8c0d-14cadb6ad6ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.189103 Sep 03 01:33:46.354810 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e549ab0b-e08a-4511-8992-40c0d9a28643 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:46.366584 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 66/136] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:46 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:46.366769 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e549ab0b-e08a-4511-8992-40c0d9a28643 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:46.366769 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e549ab0b-e08a-4511-8992-40c0d9a28643 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:46.366769 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e549ab0b-e08a-4511-8992-40c0d9a28643 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:46.366769 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e549ab0b-e08a-4511-8992-40c0d9a28643 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:46.367048 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e549ab0b-e08a-4511-8992-40c0d9a28643 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:46.367048 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e549ab0b-e08a-4511-8992-40c0d9a28643 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:46.463500 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f0c92fc2-8565-42f7-9a09-e87fc8714b28 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:46.464106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f0c92fc2-8565-42f7-9a09-e87fc8714b28 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:46.467153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:46.470824 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f0c92fc2-8565-42f7-9a09-e87fc8714b28 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:46.471311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f0c92fc2-8565-42f7-9a09-e87fc8714b28 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:46.471745 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f0c92fc2-8565-42f7-9a09-e87fc8714b28 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:46.472491 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f0c92fc2-8565-42f7-9a09-e87fc8714b28 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:46.472946 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f0c92fc2-8565-42f7-9a09-e87fc8714b28 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:46.473373 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f0c92fc2-8565-42f7-9a09-e87fc8714b28 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:46.501451 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e549ab0b-e08a-4511-8992-40c0d9a28643 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:46.510102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e549ab0b-e08a-4511-8992-40c0d9a28643 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.160244 Sep 03 01:33:46.510922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 71/137] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:46 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:46.622306 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f0c92fc2-8565-42f7-9a09-e87fc8714b28 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:46.635642 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f0c92fc2-8565-42f7-9a09-e87fc8714b28 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:46.636084 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f0c92fc2-8565-42f7-9a09-e87fc8714b28 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:46.637645 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f0c92fc2-8565-42f7-9a09-e87fc8714b28 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.178665 Sep 03 01:33:46.638208 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 67/138] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:46 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:46.858594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-afe2a561-f647-4771-a577-d6764ae59f38 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:46.858594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-afe2a561-f647-4771-a577-d6764ae59f38 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:46.867651 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-63e53bd1-dd1c-46fb-a3a8-8c83cb7e90ba tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:46.868454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-63e53bd1-dd1c-46fb-a3a8-8c83cb7e90ba tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:46.870729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-afe2a561-f647-4771-a577-d6764ae59f38 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:46.871496 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-afe2a561-f647-4771-a577-d6764ae59f38 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:46.872408 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-afe2a561-f647-4771-a577-d6764ae59f38 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:46.873611 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-afe2a561-f647-4771-a577-d6764ae59f38 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:46.874280 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-afe2a561-f647-4771-a577-d6764ae59f38 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:46.874941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-afe2a561-f647-4771-a577-d6764ae59f38 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:46.878325 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e53bd1-dd1c-46fb-a3a8-8c83cb7e90ba tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:46.878851 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e53bd1-dd1c-46fb-a3a8-8c83cb7e90ba tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:46.879347 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e53bd1-dd1c-46fb-a3a8-8c83cb7e90ba tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:46.880226 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e53bd1-dd1c-46fb-a3a8-8c83cb7e90ba tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:46.880862 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e53bd1-dd1c-46fb-a3a8-8c83cb7e90ba tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:46.881424 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e53bd1-dd1c-46fb-a3a8-8c83cb7e90ba tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:47.051187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-afe2a561-f647-4771-a577-d6764ae59f38 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:47.060750 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-afe2a561-f647-4771-a577-d6764ae59f38 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.209480 Sep 03 01:33:47.061379 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 68/139] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:46 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:47.097231 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-63e53bd1-dd1c-46fb-a3a8-8c83cb7e90ba tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:47.105943 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-63e53bd1-dd1c-46fb-a3a8-8c83cb7e90ba tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.254627 Sep 03 01:33:47.106553 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 72/140] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:46 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:47.141171 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-44b9671d-23e1-4931-a7e5-f96a63b0a691 req-987f6ff6-828e-43ee-af5e-5da83d035a8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615f8d7e-2e14-4015-a24f-2b02e885ef44", "name": "network-vif-plugged", "status": "completed", "tag": "9ab23d97-93c5-443a-a734-fe9f47c27341"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:47.151001 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-44b9671d-23e1-4931-a7e5-f96a63b0a691 req-987f6ff6-828e-43ee-af5e-5da83d035a8d service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:47.151604 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-44b9671d-23e1-4931-a7e5-f96a63b0a691 req-987f6ff6-828e-43ee-af5e-5da83d035a8d service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:47.152112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-44b9671d-23e1-4931-a7e5-f96a63b0a691 req-987f6ff6-828e-43ee-af5e-5da83d035a8d service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:47.164106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-44b9671d-23e1-4931-a7e5-f96a63b0a691 req-987f6ff6-828e-43ee-af5e-5da83d035a8d service nova] Creating event network-vif-plugged:9ab23d97-93c5-443a-a734-fe9f47c27341 for instance 615f8d7e-2e14-4015-a24f-2b02e885ef44 on hv-cinder-83800 Sep 03 01:33:47.169300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-44b9671d-23e1-4931-a7e5-f96a63b0a691 req-987f6ff6-828e-43ee-af5e-5da83d035a8d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106521 Sep 03 01:33:47.170025 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 69/141] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:47.379615 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-fbab89a4-c6e5-47c7-941f-b3d9b6143c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:47.380811 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-fbab89a4-c6e5-47c7-941f-b3d9b6143c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:47.387311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fbab89a4-c6e5-47c7-941f-b3d9b6143c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:47.387833 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fbab89a4-c6e5-47c7-941f-b3d9b6143c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:47.388260 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fbab89a4-c6e5-47c7-941f-b3d9b6143c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:47.395054 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fbab89a4-c6e5-47c7-941f-b3d9b6143c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:47.395054 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fbab89a4-c6e5-47c7-941f-b3d9b6143c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:47.395054 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fbab89a4-c6e5-47c7-941f-b3d9b6143c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:47.530116 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-fbab89a4-c6e5-47c7-941f-b3d9b6143c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:47.534425 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-909a9151-cd1f-436f-8214-e4728e26f1a2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:47.535338 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-909a9151-cd1f-436f-8214-e4728e26f1a2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:47.539279 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-fbab89a4-c6e5-47c7-941f-b3d9b6143c27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.163936 Sep 03 01:33:47.554476 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 73/142] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:47 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:47.554672 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-909a9151-cd1f-436f-8214-e4728e26f1a2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:47.554672 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-909a9151-cd1f-436f-8214-e4728e26f1a2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:47.554672 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-909a9151-cd1f-436f-8214-e4728e26f1a2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:47.554672 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-909a9151-cd1f-436f-8214-e4728e26f1a2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:47.555013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-909a9151-cd1f-436f-8214-e4728e26f1a2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:47.555013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-909a9151-cd1f-436f-8214-e4728e26f1a2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:47.665918 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0d972878-a73f-48b1-b7ab-031491018692 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:47.668626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-0d972878-a73f-48b1-b7ab-031491018692 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:47.674484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0d972878-a73f-48b1-b7ab-031491018692 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:47.674970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0d972878-a73f-48b1-b7ab-031491018692 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:47.675575 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0d972878-a73f-48b1-b7ab-031491018692 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:47.676283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0d972878-a73f-48b1-b7ab-031491018692 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:47.676717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0d972878-a73f-48b1-b7ab-031491018692 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:47.677335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0d972878-a73f-48b1-b7ab-031491018692 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:47.743563 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-909a9151-cd1f-436f-8214-e4728e26f1a2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:47.757137 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-909a9151-cd1f-436f-8214-e4728e26f1a2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.227597 Sep 03 01:33:47.759705 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 70/143] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:47 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:47.832160 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-0d972878-a73f-48b1-b7ab-031491018692 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:47.841157 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-0d972878-a73f-48b1-b7ab-031491018692 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:47.842608 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-0d972878-a73f-48b1-b7ab-031491018692 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:47.843704 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0d972878-a73f-48b1-b7ab-031491018692 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.182439 Sep 03 01:33:47.851370 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 74/144] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:47 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:48.083754 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ea59eff4-78de-442f-b971-ae05be952fec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:48.084282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ea59eff4-78de-442f-b971-ae05be952fec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:48.090241 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ea59eff4-78de-442f-b971-ae05be952fec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:48.090747 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ea59eff4-78de-442f-b971-ae05be952fec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:48.091173 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ea59eff4-78de-442f-b971-ae05be952fec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:48.091848 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ea59eff4-78de-442f-b971-ae05be952fec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:48.092295 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ea59eff4-78de-442f-b971-ae05be952fec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:48.092712 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ea59eff4-78de-442f-b971-ae05be952fec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:48.111856 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:48.129653 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-870cd30a-d8b7-4a15-ad45-58f68a19f85e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:48.130259 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-870cd30a-d8b7-4a15-ad45-58f68a19f85e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:48.137440 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-870cd30a-d8b7-4a15-ad45-58f68a19f85e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:48.137929 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-870cd30a-d8b7-4a15-ad45-58f68a19f85e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:48.138389 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-870cd30a-d8b7-4a15-ad45-58f68a19f85e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:48.139087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-870cd30a-d8b7-4a15-ad45-58f68a19f85e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:48.139540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-870cd30a-d8b7-4a15-ad45-58f68a19f85e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:48.139966 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-870cd30a-d8b7-4a15-ad45-58f68a19f85e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:48.235773 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ea59eff4-78de-442f-b971-ae05be952fec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:48.244634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ea59eff4-78de-442f-b971-ae05be952fec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.164932 Sep 03 01:33:48.245221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 71/145] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:48 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:48.271808 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-870cd30a-d8b7-4a15-ad45-58f68a19f85e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:48.279647 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-870cd30a-d8b7-4a15-ad45-58f68a19f85e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.153877 Sep 03 01:33:48.280212 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 75/146] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:48 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:48.560944 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ab279096-d2e9-405f-bfb9-b0c244fee9f3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:48.561544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ab279096-d2e9-405f-bfb9-b0c244fee9f3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:48.567456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ab279096-d2e9-405f-bfb9-b0c244fee9f3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:48.567929 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ab279096-d2e9-405f-bfb9-b0c244fee9f3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:48.568357 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ab279096-d2e9-405f-bfb9-b0c244fee9f3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:48.569027 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ab279096-d2e9-405f-bfb9-b0c244fee9f3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:48.569557 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ab279096-d2e9-405f-bfb9-b0c244fee9f3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:48.569975 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ab279096-d2e9-405f-bfb9-b0c244fee9f3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:48.697225 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ab279096-d2e9-405f-bfb9-b0c244fee9f3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:48.704758 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ab279096-d2e9-405f-bfb9-b0c244fee9f3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.147628 Sep 03 01:33:48.705323 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 72/147] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:48 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:48.782133 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7b4c9905-cba3-40c1-b9d8-5b7958fa4849 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:48.782750 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7b4c9905-cba3-40c1-b9d8-5b7958fa4849 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:48.789465 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7b4c9905-cba3-40c1-b9d8-5b7958fa4849 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:48.789938 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7b4c9905-cba3-40c1-b9d8-5b7958fa4849 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:48.790386 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7b4c9905-cba3-40c1-b9d8-5b7958fa4849 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:48.791059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7b4c9905-cba3-40c1-b9d8-5b7958fa4849 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:48.791503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7b4c9905-cba3-40c1-b9d8-5b7958fa4849 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:48.791916 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7b4c9905-cba3-40c1-b9d8-5b7958fa4849 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:48.869140 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7f21a901-1226-4bd4-9fb0-3451794e6ef4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:48.869751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7f21a901-1226-4bd4-9fb0-3451794e6ef4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:48.875975 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7f21a901-1226-4bd4-9fb0-3451794e6ef4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:48.876460 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7f21a901-1226-4bd4-9fb0-3451794e6ef4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:48.876896 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7f21a901-1226-4bd4-9fb0-3451794e6ef4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:48.877580 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7f21a901-1226-4bd4-9fb0-3451794e6ef4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:48.878030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7f21a901-1226-4bd4-9fb0-3451794e6ef4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:48.878475 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7f21a901-1226-4bd4-9fb0-3451794e6ef4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:48.924105 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7b4c9905-cba3-40c1-b9d8-5b7958fa4849 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:48.934908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7b4c9905-cba3-40c1-b9d8-5b7958fa4849 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.156615 Sep 03 01:33:48.948317 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 76/148] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:48 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:49.029152 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7f21a901-1226-4bd4-9fb0-3451794e6ef4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:49.037817 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7f21a901-1226-4bd4-9fb0-3451794e6ef4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:49.039334 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7f21a901-1226-4bd4-9fb0-3451794e6ef4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:49.040443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7f21a901-1226-4bd4-9fb0-3451794e6ef4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.175266 Sep 03 01:33:49.041006 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 73/149] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:48 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:49.184561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-9b06785c-1ad7-4218-a8af-7d043ba49ffc req-dddfad7c-48d3-4f74-ab61-16a62b965c27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea4f761-54b0-4e77-9d84-5143f79c4e8a", "name": "network-vif-plugged", "status": "completed", "tag": "e5fef679-f9d4-4ff4-99a4-3e18be20bd06"}, {"server_uuid": "05cc922e-348e-42a7-a4ff-6b8ba6c91fad", "name": "network-vif-plugged", "status": "completed", "tag": "4b292e8b-d77c-4f44-9888-e42a1b3cbaef"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:33:49.194708 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-9b06785c-1ad7-4218-a8af-7d043ba49ffc req-dddfad7c-48d3-4f74-ab61-16a62b965c27 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:49.195172 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-9b06785c-1ad7-4218-a8af-7d043ba49ffc req-dddfad7c-48d3-4f74-ab61-16a62b965c27 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:49.195592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-9b06785c-1ad7-4218-a8af-7d043ba49ffc req-dddfad7c-48d3-4f74-ab61-16a62b965c27 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:49.207978 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-9b06785c-1ad7-4218-a8af-7d043ba49ffc req-dddfad7c-48d3-4f74-ab61-16a62b965c27 service nova] Creating event network-vif-plugged:e5fef679-f9d4-4ff4-99a4-3e18be20bd06 for instance dea4f761-54b0-4e77-9d84-5143f79c4e8a on hv-cinder-83800 Sep 03 01:33:49.208502 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-9b06785c-1ad7-4218-a8af-7d043ba49ffc req-dddfad7c-48d3-4f74-ab61-16a62b965c27 service nova] Creating event network-vif-plugged:4b292e8b-d77c-4f44-9888-e42a1b3cbaef for instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad on hv-cinder-83800 Sep 03 01:33:49.214931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-9b06785c-1ad7-4218-a8af-7d043ba49ffc req-dddfad7c-48d3-4f74-ab61-16a62b965c27 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033958 Sep 03 01:33:49.215728 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 77/150] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:33:49.268327 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-986a62eb-c327-4b31-b4b1-32ca95c765ae tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:49.268928 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-986a62eb-c327-4b31-b4b1-32ca95c765ae tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:49.274953 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-986a62eb-c327-4b31-b4b1-32ca95c765ae tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:49.275429 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-986a62eb-c327-4b31-b4b1-32ca95c765ae tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:49.275856 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-986a62eb-c327-4b31-b4b1-32ca95c765ae tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:49.276529 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-986a62eb-c327-4b31-b4b1-32ca95c765ae tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:49.276973 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-986a62eb-c327-4b31-b4b1-32ca95c765ae tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:49.277389 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-986a62eb-c327-4b31-b4b1-32ca95c765ae tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:49.302804 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-18e469ea-19d1-4b7a-a645-d8d413c46779 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:49.303497 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-18e469ea-19d1-4b7a-a645-d8d413c46779 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:49.310480 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-18e469ea-19d1-4b7a-a645-d8d413c46779 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:49.310965 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-18e469ea-19d1-4b7a-a645-d8d413c46779 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:49.311401 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-18e469ea-19d1-4b7a-a645-d8d413c46779 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:49.312089 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-18e469ea-19d1-4b7a-a645-d8d413c46779 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:49.312542 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-18e469ea-19d1-4b7a-a645-d8d413c46779 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:49.312965 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-18e469ea-19d1-4b7a-a645-d8d413c46779 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:49.406104 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-986a62eb-c327-4b31-b4b1-32ca95c765ae tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:49.414497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-986a62eb-c327-4b31-b4b1-32ca95c765ae tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.149959 Sep 03 01:33:49.415400 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 74/151] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:49 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:49.445073 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-18e469ea-19d1-4b7a-a645-d8d413c46779 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:49.452648 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-18e469ea-19d1-4b7a-a645-d8d413c46779 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.154026 Sep 03 01:33:49.453214 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 78/152] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:49 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:49.727907 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9be37d43-ec75-4b8b-94be-e834cffa12a9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:49.728517 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9be37d43-ec75-4b8b-94be-e834cffa12a9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:49.734730 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9be37d43-ec75-4b8b-94be-e834cffa12a9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:49.735223 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9be37d43-ec75-4b8b-94be-e834cffa12a9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:49.735658 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9be37d43-ec75-4b8b-94be-e834cffa12a9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:49.736359 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9be37d43-ec75-4b8b-94be-e834cffa12a9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:49.736815 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9be37d43-ec75-4b8b-94be-e834cffa12a9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:49.737243 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9be37d43-ec75-4b8b-94be-e834cffa12a9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:49.861842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9be37d43-ec75-4b8b-94be-e834cffa12a9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:49.869597 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9be37d43-ec75-4b8b-94be-e834cffa12a9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.146270 Sep 03 01:33:49.870165 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 75/153] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:49 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:49.959013 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-890f0804-295c-4b52-bf6f-4f743fbdb41b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:49.959535 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-890f0804-295c-4b52-bf6f-4f743fbdb41b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:49.966163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-890f0804-295c-4b52-bf6f-4f743fbdb41b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:49.966664 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-890f0804-295c-4b52-bf6f-4f743fbdb41b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:49.967089 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-890f0804-295c-4b52-bf6f-4f743fbdb41b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:49.967758 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-890f0804-295c-4b52-bf6f-4f743fbdb41b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:49.968228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-890f0804-295c-4b52-bf6f-4f743fbdb41b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:49.968643 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-890f0804-295c-4b52-bf6f-4f743fbdb41b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:50.066378 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-50e497c8-d392-4aed-9ce6-30b9cca06e86 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:50.067033 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-50e497c8-d392-4aed-9ce6-30b9cca06e86 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:50.073924 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-50e497c8-d392-4aed-9ce6-30b9cca06e86 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:50.074447 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-50e497c8-d392-4aed-9ce6-30b9cca06e86 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:50.074884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-50e497c8-d392-4aed-9ce6-30b9cca06e86 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:50.075578 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-50e497c8-d392-4aed-9ce6-30b9cca06e86 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:50.076028 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-50e497c8-d392-4aed-9ce6-30b9cca06e86 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:50.076450 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-50e497c8-d392-4aed-9ce6-30b9cca06e86 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:50.100735 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-890f0804-295c-4b52-bf6f-4f743fbdb41b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:50.108905 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-890f0804-295c-4b52-bf6f-4f743fbdb41b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.153689 Sep 03 01:33:50.109488 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 79/154] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:49 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:50.207211 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-50e497c8-d392-4aed-9ce6-30b9cca06e86 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:50.216217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-50e497c8-d392-4aed-9ce6-30b9cca06e86 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:50.217791 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-50e497c8-d392-4aed-9ce6-30b9cca06e86 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:50.219833 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-50e497c8-d392-4aed-9ce6-30b9cca06e86 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.157055 Sep 03 01:33:50.220857 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 76/155] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:50 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:50.438729 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-dcc756c5-97b8-4368-af2c-db7388e12d34 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:50.439333 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-dcc756c5-97b8-4368-af2c-db7388e12d34 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:50.446155 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dcc756c5-97b8-4368-af2c-db7388e12d34 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:50.446657 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dcc756c5-97b8-4368-af2c-db7388e12d34 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:50.447085 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dcc756c5-97b8-4368-af2c-db7388e12d34 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:50.447756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dcc756c5-97b8-4368-af2c-db7388e12d34 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:50.448197 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dcc756c5-97b8-4368-af2c-db7388e12d34 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:50.448610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dcc756c5-97b8-4368-af2c-db7388e12d34 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:50.475379 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-21829888-8645-47fd-a5c9-9ea5bfcc610a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:50.475883 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-21829888-8645-47fd-a5c9-9ea5bfcc610a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:50.481736 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-21829888-8645-47fd-a5c9-9ea5bfcc610a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:50.482220 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-21829888-8645-47fd-a5c9-9ea5bfcc610a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:50.482690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-21829888-8645-47fd-a5c9-9ea5bfcc610a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:50.483379 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-21829888-8645-47fd-a5c9-9ea5bfcc610a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:50.483828 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-21829888-8645-47fd-a5c9-9ea5bfcc610a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:50.484251 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-21829888-8645-47fd-a5c9-9ea5bfcc610a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:50.576025 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-dcc756c5-97b8-4368-af2c-db7388e12d34 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:50.584091 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-dcc756c5-97b8-4368-af2c-db7388e12d34 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.149471 Sep 03 01:33:50.584675 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 80/156] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:50 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:50.615108 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-21829888-8645-47fd-a5c9-9ea5bfcc610a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:50.623251 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-21829888-8645-47fd-a5c9-9ea5bfcc610a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.151712 Sep 03 01:33:50.623829 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 77/157] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:50 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:50.893490 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-dd2feda2-c098-48fc-b23c-b9ebd8d71f28 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:50.894107 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-dd2feda2-c098-48fc-b23c-b9ebd8d71f28 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:50.901095 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd2feda2-c098-48fc-b23c-b9ebd8d71f28 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:50.901577 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd2feda2-c098-48fc-b23c-b9ebd8d71f28 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:50.902009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd2feda2-c098-48fc-b23c-b9ebd8d71f28 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:50.902719 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd2feda2-c098-48fc-b23c-b9ebd8d71f28 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:50.903218 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd2feda2-c098-48fc-b23c-b9ebd8d71f28 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:50.903646 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd2feda2-c098-48fc-b23c-b9ebd8d71f28 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:51.081491 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-dd2feda2-c098-48fc-b23c-b9ebd8d71f28 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:51.093003 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-dd2feda2-c098-48fc-b23c-b9ebd8d71f28 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.202431 Sep 03 01:33:51.093602 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 81/158] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:50 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:51.132657 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6afde95b-808e-4de1-92e6-a8d4efbc3562 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:51.133419 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6afde95b-808e-4de1-92e6-a8d4efbc3562 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:51.139823 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6afde95b-808e-4de1-92e6-a8d4efbc3562 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:51.140309 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6afde95b-808e-4de1-92e6-a8d4efbc3562 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:51.140744 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6afde95b-808e-4de1-92e6-a8d4efbc3562 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:51.141552 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6afde95b-808e-4de1-92e6-a8d4efbc3562 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:51.144926 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6afde95b-808e-4de1-92e6-a8d4efbc3562 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:51.144926 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6afde95b-808e-4de1-92e6-a8d4efbc3562 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:51.245974 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1f8e749b-6b53-44c9-abfd-a58111e33210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:51.246872 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1f8e749b-6b53-44c9-abfd-a58111e33210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:51.253565 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1f8e749b-6b53-44c9-abfd-a58111e33210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:51.254162 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1f8e749b-6b53-44c9-abfd-a58111e33210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:51.254735 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1f8e749b-6b53-44c9-abfd-a58111e33210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:51.255658 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1f8e749b-6b53-44c9-abfd-a58111e33210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:51.256070 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1f8e749b-6b53-44c9-abfd-a58111e33210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:51.258539 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1f8e749b-6b53-44c9-abfd-a58111e33210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:51.284077 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6afde95b-808e-4de1-92e6-a8d4efbc3562 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:51.293348 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6afde95b-808e-4de1-92e6-a8d4efbc3562 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.165650 Sep 03 01:33:51.294126 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 78/159] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:51 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:51.401415 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1f8e749b-6b53-44c9-abfd-a58111e33210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:51.410727 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1f8e749b-6b53-44c9-abfd-a58111e33210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:51.412169 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1f8e749b-6b53-44c9-abfd-a58111e33210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:51.413832 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1f8e749b-6b53-44c9-abfd-a58111e33210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.172592 Sep 03 01:33:51.414496 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 82/160] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:51 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:51.607315 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-62da9647-afc7-4253-a3de-08260cb6cbf3 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:51.607924 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-62da9647-afc7-4253-a3de-08260cb6cbf3 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:51.615137 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62da9647-afc7-4253-a3de-08260cb6cbf3 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:51.615625 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62da9647-afc7-4253-a3de-08260cb6cbf3 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:51.616830 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62da9647-afc7-4253-a3de-08260cb6cbf3 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:51.623255 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62da9647-afc7-4253-a3de-08260cb6cbf3 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:51.623255 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62da9647-afc7-4253-a3de-08260cb6cbf3 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:51.623918 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62da9647-afc7-4253-a3de-08260cb6cbf3 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:51.646051 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7c4abdf7-9fb7-4b40-9d9a-3a245978d81f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:51.647119 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7c4abdf7-9fb7-4b40-9d9a-3a245978d81f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:51.651265 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=100 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:51.655004 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c4abdf7-9fb7-4b40-9d9a-3a245978d81f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:51.655946 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c4abdf7-9fb7-4b40-9d9a-3a245978d81f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:51.656432 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c4abdf7-9fb7-4b40-9d9a-3a245978d81f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:51.657085 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c4abdf7-9fb7-4b40-9d9a-3a245978d81f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:51.657531 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c4abdf7-9fb7-4b40-9d9a-3a245978d81f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:51.657958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c4abdf7-9fb7-4b40-9d9a-3a245978d81f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:51.771037 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-62da9647-afc7-4253-a3de-08260cb6cbf3 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:51.779351 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-62da9647-afc7-4253-a3de-08260cb6cbf3 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.175848 Sep 03 01:33:51.779930 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 79/161] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:51 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:51.814141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7c4abdf7-9fb7-4b40-9d9a-3a245978d81f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:51.822492 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7c4abdf7-9fb7-4b40-9d9a-3a245978d81f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.180246 Sep 03 01:33:51.823066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 83/162] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:51 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:52.118187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-fbadcfce-b790-41ba-8843-64084290bb37 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:52.118826 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-fbadcfce-b790-41ba-8843-64084290bb37 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:52.124914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fbadcfce-b790-41ba-8843-64084290bb37 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:52.125402 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fbadcfce-b790-41ba-8843-64084290bb37 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:52.125835 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fbadcfce-b790-41ba-8843-64084290bb37 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:52.126556 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fbadcfce-b790-41ba-8843-64084290bb37 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:52.127127 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fbadcfce-b790-41ba-8843-64084290bb37 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:52.127554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fbadcfce-b790-41ba-8843-64084290bb37 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:52.257356 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-fbadcfce-b790-41ba-8843-64084290bb37 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:52.264988 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-fbadcfce-b790-41ba-8843-64084290bb37 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.151240 Sep 03 01:33:52.265548 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 80/163] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:52 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:52.315191 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f5978cfc-a410-4f3b-8a38-2632e5d90653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:52.318914 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f5978cfc-a410-4f3b-8a38-2632e5d90653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:52.322330 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5978cfc-a410-4f3b-8a38-2632e5d90653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:52.322837 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5978cfc-a410-4f3b-8a38-2632e5d90653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:52.323266 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5978cfc-a410-4f3b-8a38-2632e5d90653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:52.323944 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5978cfc-a410-4f3b-8a38-2632e5d90653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:52.324396 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5978cfc-a410-4f3b-8a38-2632e5d90653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:52.324811 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5978cfc-a410-4f3b-8a38-2632e5d90653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:52.438857 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-dc51f5e6-802a-4602-aa30-f5d879a01172 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:52.439494 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-dc51f5e6-802a-4602-aa30-f5d879a01172 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:52.446316 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc51f5e6-802a-4602-aa30-f5d879a01172 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:52.446849 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc51f5e6-802a-4602-aa30-f5d879a01172 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:52.447308 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc51f5e6-802a-4602-aa30-f5d879a01172 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:52.447991 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc51f5e6-802a-4602-aa30-f5d879a01172 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:52.448438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc51f5e6-802a-4602-aa30-f5d879a01172 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:52.448904 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc51f5e6-802a-4602-aa30-f5d879a01172 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:52.455365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-f5978cfc-a410-4f3b-8a38-2632e5d90653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:52.463185 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f5978cfc-a410-4f3b-8a38-2632e5d90653 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.151920 Sep 03 01:33:52.464005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 84/164] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:52 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:52.576858 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dc51f5e6-802a-4602-aa30-f5d879a01172 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:52.585385 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dc51f5e6-802a-4602-aa30-f5d879a01172 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:52.586992 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dc51f5e6-802a-4602-aa30-f5d879a01172 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:52.588088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-dc51f5e6-802a-4602-aa30-f5d879a01172 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.153088 Sep 03 01:33:52.588645 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 81/165] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:52 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:33:52.802160 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8a58b1b3-c606-460b-ac85-3c6ffb269fcd tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:52.802795 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8a58b1b3-c606-460b-ac85-3c6ffb269fcd tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:52.808974 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a58b1b3-c606-460b-ac85-3c6ffb269fcd tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:52.809450 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a58b1b3-c606-460b-ac85-3c6ffb269fcd tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:52.809878 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a58b1b3-c606-460b-ac85-3c6ffb269fcd tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:52.810597 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a58b1b3-c606-460b-ac85-3c6ffb269fcd tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:52.811044 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a58b1b3-c606-460b-ac85-3c6ffb269fcd tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:52.811457 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a58b1b3-c606-460b-ac85-3c6ffb269fcd tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:52.844842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-74d3462a-61ba-45b0-8a76-3bd108a42df7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:52.845754 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-74d3462a-61ba-45b0-8a76-3bd108a42df7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:52.852474 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74d3462a-61ba-45b0-8a76-3bd108a42df7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:52.853028 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74d3462a-61ba-45b0-8a76-3bd108a42df7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:52.853464 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74d3462a-61ba-45b0-8a76-3bd108a42df7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:52.854151 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74d3462a-61ba-45b0-8a76-3bd108a42df7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:52.854623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74d3462a-61ba-45b0-8a76-3bd108a42df7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:52.855042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74d3462a-61ba-45b0-8a76-3bd108a42df7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:52.944878 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8a58b1b3-c606-460b-ac85-3c6ffb269fcd tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:52.965755 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8a58b1b3-c606-460b-ac85-3c6ffb269fcd tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.167265 Sep 03 01:33:52.966669 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 85/166] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:52 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:52.989134 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-74d3462a-61ba-45b0-8a76-3bd108a42df7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:52.996914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-74d3462a-61ba-45b0-8a76-3bd108a42df7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.155793 Sep 03 01:33:52.997496 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 82/167] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:52 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:53.287238 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f3fd9938-d942-447f-9afb-927a00ec61d4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:53.288571 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f3fd9938-d942-447f-9afb-927a00ec61d4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:53.294451 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f3fd9938-d942-447f-9afb-927a00ec61d4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:53.294927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f3fd9938-d942-447f-9afb-927a00ec61d4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:53.295383 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f3fd9938-d942-447f-9afb-927a00ec61d4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:53.296055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f3fd9938-d942-447f-9afb-927a00ec61d4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:53.296503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f3fd9938-d942-447f-9afb-927a00ec61d4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:53.296923 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f3fd9938-d942-447f-9afb-927a00ec61d4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:53.314247 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=100 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:53.429306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-f3fd9938-d942-447f-9afb-927a00ec61d4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:53.436911 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f3fd9938-d942-447f-9afb-927a00ec61d4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.153578 Sep 03 01:33:53.437469 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 86/168] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:53 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:53.485886 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b7a46231-b052-4df6-a06c-db7c21a5ee1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:53.486516 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b7a46231-b052-4df6-a06c-db7c21a5ee1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:53.492530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b7a46231-b052-4df6-a06c-db7c21a5ee1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:53.493003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b7a46231-b052-4df6-a06c-db7c21a5ee1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:53.493436 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b7a46231-b052-4df6-a06c-db7c21a5ee1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:53.494102 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b7a46231-b052-4df6-a06c-db7c21a5ee1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:53.494575 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b7a46231-b052-4df6-a06c-db7c21a5ee1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:53.494989 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b7a46231-b052-4df6-a06c-db7c21a5ee1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:53.613178 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-42cee32e-ec34-4ec9-b12f-cdc700fddd13 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:53.614062 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-42cee32e-ec34-4ec9-b12f-cdc700fddd13 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:53.620302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-42cee32e-ec34-4ec9-b12f-cdc700fddd13 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:53.620786 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-42cee32e-ec34-4ec9-b12f-cdc700fddd13 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:53.621216 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-42cee32e-ec34-4ec9-b12f-cdc700fddd13 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:53.621900 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-42cee32e-ec34-4ec9-b12f-cdc700fddd13 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:53.622371 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-42cee32e-ec34-4ec9-b12f-cdc700fddd13 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:53.622786 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-42cee32e-ec34-4ec9-b12f-cdc700fddd13 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:53.627510 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b7a46231-b052-4df6-a06c-db7c21a5ee1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:53.635689 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b7a46231-b052-4df6-a06c-db7c21a5ee1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.153539 Sep 03 01:33:53.639842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 83/169] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:53 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:53.748188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-42cee32e-ec34-4ec9-b12f-cdc700fddd13 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:53.756103 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-42cee32e-ec34-4ec9-b12f-cdc700fddd13 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:53.758206 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-42cee32e-ec34-4ec9-b12f-cdc700fddd13 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:53.759318 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-42cee32e-ec34-4ec9-b12f-cdc700fddd13 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.150063 Sep 03 01:33:53.759882 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 87/170] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:53 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:53.988866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-af13cb51-965e-41f3-b1d3-1e0ff64c3e67 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:53.989473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-af13cb51-965e-41f3-b1d3-1e0ff64c3e67 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:53.996029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-af13cb51-965e-41f3-b1d3-1e0ff64c3e67 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:53.996506 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-af13cb51-965e-41f3-b1d3-1e0ff64c3e67 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:53.996943 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-af13cb51-965e-41f3-b1d3-1e0ff64c3e67 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:53.997619 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-af13cb51-965e-41f3-b1d3-1e0ff64c3e67 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:53.998064 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-af13cb51-965e-41f3-b1d3-1e0ff64c3e67 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:53.998517 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-af13cb51-965e-41f3-b1d3-1e0ff64c3e67 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:54.019854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9b69615c-999a-443d-ab50-090234a9cf42 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:54.020547 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9b69615c-999a-443d-ab50-090234a9cf42 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:54.031059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9b69615c-999a-443d-ab50-090234a9cf42 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:54.031543 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9b69615c-999a-443d-ab50-090234a9cf42 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:54.031979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9b69615c-999a-443d-ab50-090234a9cf42 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:54.032664 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9b69615c-999a-443d-ab50-090234a9cf42 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:54.033112 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9b69615c-999a-443d-ab50-090234a9cf42 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:54.033527 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9b69615c-999a-443d-ab50-090234a9cf42 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:54.144157 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-af13cb51-965e-41f3-b1d3-1e0ff64c3e67 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:54.153446 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-af13cb51-965e-41f3-b1d3-1e0ff64c3e67 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.168359 Sep 03 01:33:54.158419 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 84/171] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:53 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:54.169922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9b69615c-999a-443d-ab50-090234a9cf42 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:54.177472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9b69615c-999a-443d-ab50-090234a9cf42 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.161523 Sep 03 01:33:54.178041 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 88/172] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:54 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:54.459141 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-78a9bc33-c024-42c0-9bce-e8aed9b92eec tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:54.459727 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-78a9bc33-c024-42c0-9bce-e8aed9b92eec tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:54.465527 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-78a9bc33-c024-42c0-9bce-e8aed9b92eec tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:54.466003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-78a9bc33-c024-42c0-9bce-e8aed9b92eec tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:54.466464 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-78a9bc33-c024-42c0-9bce-e8aed9b92eec tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:54.467144 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-78a9bc33-c024-42c0-9bce-e8aed9b92eec tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:54.467588 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-78a9bc33-c024-42c0-9bce-e8aed9b92eec tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:54.468007 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-78a9bc33-c024-42c0-9bce-e8aed9b92eec tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:54.597157 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-78a9bc33-c024-42c0-9bce-e8aed9b92eec tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:54.605385 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-78a9bc33-c024-42c0-9bce-e8aed9b92eec tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.150211 Sep 03 01:33:54.605945 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 85/173] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:54 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:54.658120 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0db932b7-e708-400a-91f2-205e81c618e3 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:54.658780 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-0db932b7-e708-400a-91f2-205e81c618e3 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:54.665219 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0db932b7-e708-400a-91f2-205e81c618e3 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:54.665694 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0db932b7-e708-400a-91f2-205e81c618e3 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:54.666123 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0db932b7-e708-400a-91f2-205e81c618e3 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:54.666852 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0db932b7-e708-400a-91f2-205e81c618e3 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:54.667297 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0db932b7-e708-400a-91f2-205e81c618e3 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:54.667713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0db932b7-e708-400a-91f2-205e81c618e3 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:54.784856 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-15ecb3d7-6473-4f55-9e1f-bdf6c63ffff3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:54.785283 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-15ecb3d7-6473-4f55-9e1f-bdf6c63ffff3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:54.791712 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-15ecb3d7-6473-4f55-9e1f-bdf6c63ffff3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:54.792254 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-15ecb3d7-6473-4f55-9e1f-bdf6c63ffff3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:54.792689 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-15ecb3d7-6473-4f55-9e1f-bdf6c63ffff3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:54.793363 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-15ecb3d7-6473-4f55-9e1f-bdf6c63ffff3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:54.793810 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-15ecb3d7-6473-4f55-9e1f-bdf6c63ffff3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:54.794235 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-15ecb3d7-6473-4f55-9e1f-bdf6c63ffff3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:54.798985 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-0db932b7-e708-400a-91f2-205e81c618e3 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:54.807810 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0db932b7-e708-400a-91f2-205e81c618e3 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.153639 Sep 03 01:33:54.808399 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 89/174] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:54 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:54.928025 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-15ecb3d7-6473-4f55-9e1f-bdf6c63ffff3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:54.936779 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-15ecb3d7-6473-4f55-9e1f-bdf6c63ffff3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:54.938199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-15ecb3d7-6473-4f55-9e1f-bdf6c63ffff3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:54.939812 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-15ecb3d7-6473-4f55-9e1f-bdf6c63ffff3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.159438 Sep 03 01:33:54.940372 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 86/175] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:54 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:55.177178 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-103bea19-bfe1-4425-8d4c-d222e15181f7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:55.177781 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-103bea19-bfe1-4425-8d4c-d222e15181f7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:55.183759 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-103bea19-bfe1-4425-8d4c-d222e15181f7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:55.184230 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-103bea19-bfe1-4425-8d4c-d222e15181f7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:55.184658 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-103bea19-bfe1-4425-8d4c-d222e15181f7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:55.185329 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-103bea19-bfe1-4425-8d4c-d222e15181f7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:55.185768 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-103bea19-bfe1-4425-8d4c-d222e15181f7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:55.186185 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-103bea19-bfe1-4425-8d4c-d222e15181f7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:55.202238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d3dec9e6-84dc-4aef-bb68-f4c80b3c68ab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:55.202967 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d3dec9e6-84dc-4aef-bb68-f4c80b3c68ab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:55.209136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d3dec9e6-84dc-4aef-bb68-f4c80b3c68ab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:55.210205 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d3dec9e6-84dc-4aef-bb68-f4c80b3c68ab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:55.210710 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d3dec9e6-84dc-4aef-bb68-f4c80b3c68ab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:55.211404 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d3dec9e6-84dc-4aef-bb68-f4c80b3c68ab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:55.212047 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d3dec9e6-84dc-4aef-bb68-f4c80b3c68ab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:55.212479 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d3dec9e6-84dc-4aef-bb68-f4c80b3c68ab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:55.318273 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-103bea19-bfe1-4425-8d4c-d222e15181f7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:55.337913 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-103bea19-bfe1-4425-8d4c-d222e15181f7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.164526 Sep 03 01:33:55.338571 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 90/176] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:55 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:55.359573 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d3dec9e6-84dc-4aef-bb68-f4c80b3c68ab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:55.367194 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d3dec9e6-84dc-4aef-bb68-f4c80b3c68ab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.168829 Sep 03 01:33:55.367761 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 87/177] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:55 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:55.628215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c64a1537-8c8e-4ecb-b942-d89c475c3498 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:55.628739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c64a1537-8c8e-4ecb-b942-d89c475c3498 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:55.635267 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c64a1537-8c8e-4ecb-b942-d89c475c3498 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:55.635737 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c64a1537-8c8e-4ecb-b942-d89c475c3498 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:55.636161 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c64a1537-8c8e-4ecb-b942-d89c475c3498 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:55.636850 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c64a1537-8c8e-4ecb-b942-d89c475c3498 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:55.637289 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c64a1537-8c8e-4ecb-b942-d89c475c3498 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:55.637702 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c64a1537-8c8e-4ecb-b942-d89c475c3498 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:55.769025 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c64a1537-8c8e-4ecb-b942-d89c475c3498 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:55.777192 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c64a1537-8c8e-4ecb-b942-d89c475c3498 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.152954 Sep 03 01:33:55.777764 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 91/178] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:55 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:55.831194 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0e8ddcac-3f7d-471e-aedf-bb533756e314 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:55.831801 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0e8ddcac-3f7d-471e-aedf-bb533756e314 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:55.838160 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0e8ddcac-3f7d-471e-aedf-bb533756e314 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:55.838683 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0e8ddcac-3f7d-471e-aedf-bb533756e314 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:55.839121 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0e8ddcac-3f7d-471e-aedf-bb533756e314 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:55.839804 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0e8ddcac-3f7d-471e-aedf-bb533756e314 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:55.840259 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0e8ddcac-3f7d-471e-aedf-bb533756e314 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:55.840680 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0e8ddcac-3f7d-471e-aedf-bb533756e314 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:55.844541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:33:55.965639 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e0e21c8f-f9af-43be-b7b5-2ef468c967a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:55.966640 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e0e21c8f-f9af-43be-b7b5-2ef468c967a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:55.972627 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0e21c8f-f9af-43be-b7b5-2ef468c967a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:55.973101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0e21c8f-f9af-43be-b7b5-2ef468c967a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:55.973527 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0e21c8f-f9af-43be-b7b5-2ef468c967a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:55.976020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0e21c8f-f9af-43be-b7b5-2ef468c967a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:55.976020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0e21c8f-f9af-43be-b7b5-2ef468c967a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:55.976374 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0e8ddcac-3f7d-471e-aedf-bb533756e314 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:55.976480 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0e21c8f-f9af-43be-b7b5-2ef468c967a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:55.982628 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0e8ddcac-3f7d-471e-aedf-bb533756e314 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.155307 Sep 03 01:33:55.983207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 88/179] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:55 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:56.102374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e0e21c8f-f9af-43be-b7b5-2ef468c967a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:56.110516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e0e21c8f-f9af-43be-b7b5-2ef468c967a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:56.111966 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e0e21c8f-f9af-43be-b7b5-2ef468c967a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:56.113070 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e0e21c8f-f9af-43be-b7b5-2ef468c967a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.151367 Sep 03 01:33:56.113684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 92/180] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:55 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:56.359847 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b2152657-1524-4eef-80bb-56a2d94ea526 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:56.360615 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b2152657-1524-4eef-80bb-56a2d94ea526 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:56.367285 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2152657-1524-4eef-80bb-56a2d94ea526 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:56.367771 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2152657-1524-4eef-80bb-56a2d94ea526 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:56.368247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2152657-1524-4eef-80bb-56a2d94ea526 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:56.368969 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2152657-1524-4eef-80bb-56a2d94ea526 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:56.369602 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2152657-1524-4eef-80bb-56a2d94ea526 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:56.370034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2152657-1524-4eef-80bb-56a2d94ea526 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:56.393188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-77f3f617-5d82-4994-9562-8395d45c67c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:56.394073 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-77f3f617-5d82-4994-9562-8395d45c67c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:56.400678 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77f3f617-5d82-4994-9562-8395d45c67c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:56.401166 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77f3f617-5d82-4994-9562-8395d45c67c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:56.401600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77f3f617-5d82-4994-9562-8395d45c67c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:56.402316 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77f3f617-5d82-4994-9562-8395d45c67c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:56.403007 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77f3f617-5d82-4994-9562-8395d45c67c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:56.403356 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77f3f617-5d82-4994-9562-8395d45c67c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:56.506296 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b2152657-1524-4eef-80bb-56a2d94ea526 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:56.514016 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b2152657-1524-4eef-80bb-56a2d94ea526 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.157954 Sep 03 01:33:56.514614 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 89/181] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:56 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:56.536287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-77f3f617-5d82-4994-9562-8395d45c67c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:56.544484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-77f3f617-5d82-4994-9562-8395d45c67c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.155277 Sep 03 01:33:56.545046 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 93/182] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:56 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:56.799674 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d86b2c9d-e165-4407-9673-5870b0b80ecc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:56.800694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d86b2c9d-e165-4407-9673-5870b0b80ecc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:56.806222 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d86b2c9d-e165-4407-9673-5870b0b80ecc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:56.806732 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d86b2c9d-e165-4407-9673-5870b0b80ecc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:56.807162 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d86b2c9d-e165-4407-9673-5870b0b80ecc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:56.807843 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d86b2c9d-e165-4407-9673-5870b0b80ecc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:56.808290 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d86b2c9d-e165-4407-9673-5870b0b80ecc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:56.808707 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d86b2c9d-e165-4407-9673-5870b0b80ecc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:56.941542 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d86b2c9d-e165-4407-9673-5870b0b80ecc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:56.949732 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d86b2c9d-e165-4407-9673-5870b0b80ecc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.153985 Sep 03 01:33:56.953418 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 90/183] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:56 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:57.005203 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-65d3ad9d-0c36-4448-8c93-3947582dc4bc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:57.005799 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-65d3ad9d-0c36-4448-8c93-3947582dc4bc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:57.012462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65d3ad9d-0c36-4448-8c93-3947582dc4bc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:57.012946 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65d3ad9d-0c36-4448-8c93-3947582dc4bc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:57.013381 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65d3ad9d-0c36-4448-8c93-3947582dc4bc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:57.014081 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65d3ad9d-0c36-4448-8c93-3947582dc4bc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:57.014567 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65d3ad9d-0c36-4448-8c93-3947582dc4bc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:57.014993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65d3ad9d-0c36-4448-8c93-3947582dc4bc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:57.138919 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6db8e0a5-4360-44e7-84e2-6616f0a55c01 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:57.139687 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6db8e0a5-4360-44e7-84e2-6616f0a55c01 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:57.146019 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6db8e0a5-4360-44e7-84e2-6616f0a55c01 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:57.146544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6db8e0a5-4360-44e7-84e2-6616f0a55c01 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:57.147069 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6db8e0a5-4360-44e7-84e2-6616f0a55c01 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:57.147638 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-65d3ad9d-0c36-4448-8c93-3947582dc4bc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:57.148203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6db8e0a5-4360-44e7-84e2-6616f0a55c01 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:57.148700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6db8e0a5-4360-44e7-84e2-6616f0a55c01 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:57.149134 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6db8e0a5-4360-44e7-84e2-6616f0a55c01 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:57.156129 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-65d3ad9d-0c36-4448-8c93-3947582dc4bc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.154784 Sep 03 01:33:57.156703 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 94/184] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:57 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:57.282121 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6db8e0a5-4360-44e7-84e2-6616f0a55c01 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:57.290591 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6db8e0a5-4360-44e7-84e2-6616f0a55c01 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:57.292037 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6db8e0a5-4360-44e7-84e2-6616f0a55c01 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:57.293198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6db8e0a5-4360-44e7-84e2-6616f0a55c01 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.158218 Sep 03 01:33:57.293796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 91/185] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:57 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:57.536641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-34a4f812-9f1e-40e4-aa0e-d52593010145 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:57.537380 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-34a4f812-9f1e-40e4-aa0e-d52593010145 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:57.544066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-34a4f812-9f1e-40e4-aa0e-d52593010145 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:57.544549 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-34a4f812-9f1e-40e4-aa0e-d52593010145 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:57.544980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-34a4f812-9f1e-40e4-aa0e-d52593010145 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:57.545665 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-34a4f812-9f1e-40e4-aa0e-d52593010145 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:57.546111 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-34a4f812-9f1e-40e4-aa0e-d52593010145 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:57.546561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-34a4f812-9f1e-40e4-aa0e-d52593010145 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:57.570058 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f738ac5b-0ed5-41f4-8272-06e8219ccb75 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:57.570805 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f738ac5b-0ed5-41f4-8272-06e8219ccb75 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:57.576743 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f738ac5b-0ed5-41f4-8272-06e8219ccb75 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:57.577227 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f738ac5b-0ed5-41f4-8272-06e8219ccb75 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:57.586982 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f738ac5b-0ed5-41f4-8272-06e8219ccb75 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:57.587732 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f738ac5b-0ed5-41f4-8272-06e8219ccb75 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:57.588201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f738ac5b-0ed5-41f4-8272-06e8219ccb75 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:57.588633 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f738ac5b-0ed5-41f4-8272-06e8219ccb75 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:57.683785 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-34a4f812-9f1e-40e4-aa0e-d52593010145 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:57.691464 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-34a4f812-9f1e-40e4-aa0e-d52593010145 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.158771 Sep 03 01:33:57.692279 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 95/186] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:57 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:57.724476 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f738ac5b-0ed5-41f4-8272-06e8219ccb75 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:57.733317 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f738ac5b-0ed5-41f4-8272-06e8219ccb75 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.169904 Sep 03 01:33:57.733896 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 92/187] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:57 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:57.974436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d231273a-4b72-4221-a0f3-b412c0365674 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:57.975844 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d231273a-4b72-4221-a0f3-b412c0365674 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:57.981812 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d231273a-4b72-4221-a0f3-b412c0365674 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:57.982327 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d231273a-4b72-4221-a0f3-b412c0365674 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:57.982789 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d231273a-4b72-4221-a0f3-b412c0365674 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:57.985640 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d231273a-4b72-4221-a0f3-b412c0365674 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:57.985640 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d231273a-4b72-4221-a0f3-b412c0365674 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:57.985640 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d231273a-4b72-4221-a0f3-b412c0365674 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:58.118109 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d231273a-4b72-4221-a0f3-b412c0365674 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:58.125899 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d231273a-4b72-4221-a0f3-b412c0365674 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.155355 Sep 03 01:33:58.126495 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 96/188] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:57 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:58.179689 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0beefb1f-498d-4608-812e-9e90d49127e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:58.180263 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0beefb1f-498d-4608-812e-9e90d49127e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:58.186827 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0beefb1f-498d-4608-812e-9e90d49127e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:58.187305 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0beefb1f-498d-4608-812e-9e90d49127e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:58.187738 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0beefb1f-498d-4608-812e-9e90d49127e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:58.188417 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0beefb1f-498d-4608-812e-9e90d49127e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:58.188864 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0beefb1f-498d-4608-812e-9e90d49127e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:58.189283 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0beefb1f-498d-4608-812e-9e90d49127e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:58.318442 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ba56dfdb-e782-46fa-90bb-7c90e67fc604 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:58.319808 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ba56dfdb-e782-46fa-90bb-7c90e67fc604 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:58.326330 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0beefb1f-498d-4608-812e-9e90d49127e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:58.331098 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ba56dfdb-e782-46fa-90bb-7c90e67fc604 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:58.331587 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ba56dfdb-e782-46fa-90bb-7c90e67fc604 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:58.332020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ba56dfdb-e782-46fa-90bb-7c90e67fc604 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:58.332709 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ba56dfdb-e782-46fa-90bb-7c90e67fc604 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:58.333157 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ba56dfdb-e782-46fa-90bb-7c90e67fc604 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:58.333578 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ba56dfdb-e782-46fa-90bb-7c90e67fc604 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:58.335727 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0beefb1f-498d-4608-812e-9e90d49127e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.160326 Sep 03 01:33:58.351540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 93/189] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:58 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:58.466532 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ba56dfdb-e782-46fa-90bb-7c90e67fc604 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:58.473761 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ba56dfdb-e782-46fa-90bb-7c90e67fc604 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:58.475815 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ba56dfdb-e782-46fa-90bb-7c90e67fc604 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:58.476910 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ba56dfdb-e782-46fa-90bb-7c90e67fc604 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.162511 Sep 03 01:33:58.477464 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 97/190] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:58 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:58.714663 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-89c36147-69a9-435a-8eb8-b61a7f544635 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:58.715196 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-89c36147-69a9-435a-8eb8-b61a7f544635 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:58.721091 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-89c36147-69a9-435a-8eb8-b61a7f544635 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:58.721572 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-89c36147-69a9-435a-8eb8-b61a7f544635 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:58.722008 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-89c36147-69a9-435a-8eb8-b61a7f544635 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:58.722730 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-89c36147-69a9-435a-8eb8-b61a7f544635 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:58.723181 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-89c36147-69a9-435a-8eb8-b61a7f544635 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:58.723602 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-89c36147-69a9-435a-8eb8-b61a7f544635 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:58.756952 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ff71a700-510a-4fba-b957-35a2e3716289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:58.757555 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ff71a700-510a-4fba-b957-35a2e3716289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:58.763707 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff71a700-510a-4fba-b957-35a2e3716289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:58.764191 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff71a700-510a-4fba-b957-35a2e3716289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:58.764625 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff71a700-510a-4fba-b957-35a2e3716289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:58.765315 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff71a700-510a-4fba-b957-35a2e3716289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:58.765764 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff71a700-510a-4fba-b957-35a2e3716289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:58.766187 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff71a700-510a-4fba-b957-35a2e3716289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:58.851851 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-89c36147-69a9-435a-8eb8-b61a7f544635 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:58.859741 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-89c36147-69a9-435a-8eb8-b61a7f544635 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.148997 Sep 03 01:33:58.860320 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 94/191] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:58 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:58.897776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ff71a700-510a-4fba-b957-35a2e3716289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:58.905269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ff71a700-510a-4fba-b957-35a2e3716289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.152117 Sep 03 01:33:58.906079 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 98/192] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:58 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:33:59.149580 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-28e2bbf3-a341-494e-ab42-cc63637b286d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:59.150175 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-28e2bbf3-a341-494e-ab42-cc63637b286d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:59.156571 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-28e2bbf3-a341-494e-ab42-cc63637b286d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:59.157048 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-28e2bbf3-a341-494e-ab42-cc63637b286d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:59.157476 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-28e2bbf3-a341-494e-ab42-cc63637b286d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:59.158152 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-28e2bbf3-a341-494e-ab42-cc63637b286d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:59.158625 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-28e2bbf3-a341-494e-ab42-cc63637b286d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:59.159040 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-28e2bbf3-a341-494e-ab42-cc63637b286d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:59.289988 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-28e2bbf3-a341-494e-ab42-cc63637b286d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:59.297931 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-28e2bbf3-a341-494e-ab42-cc63637b286d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.152797 Sep 03 01:33:59.298532 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 95/193] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:59 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:59.358837 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a61a19b4-9898-45c9-b785-0b443588249e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:59.359452 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a61a19b4-9898-45c9-b785-0b443588249e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:59.365556 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a61a19b4-9898-45c9-b785-0b443588249e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:59.366585 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a61a19b4-9898-45c9-b785-0b443588249e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:59.367143 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a61a19b4-9898-45c9-b785-0b443588249e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:59.367829 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a61a19b4-9898-45c9-b785-0b443588249e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:59.368283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a61a19b4-9898-45c9-b785-0b443588249e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:59.368704 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a61a19b4-9898-45c9-b785-0b443588249e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:59.501537 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a61a19b4-9898-45c9-b785-0b443588249e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:59.505334 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-39bdb15d-2819-4b2d-b472-5987e3a99bfc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:59.505943 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-39bdb15d-2819-4b2d-b472-5987e3a99bfc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:59.509793 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a61a19b4-9898-45c9-b785-0b443588249e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.154744 Sep 03 01:33:59.510536 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 99/194] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:59 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:33:59.512409 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39bdb15d-2819-4b2d-b472-5987e3a99bfc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:59.512892 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39bdb15d-2819-4b2d-b472-5987e3a99bfc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:59.513325 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39bdb15d-2819-4b2d-b472-5987e3a99bfc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:59.514191 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39bdb15d-2819-4b2d-b472-5987e3a99bfc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:59.514502 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39bdb15d-2819-4b2d-b472-5987e3a99bfc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:59.514924 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39bdb15d-2819-4b2d-b472-5987e3a99bfc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:59.643663 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-39bdb15d-2819-4b2d-b472-5987e3a99bfc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:59.652401 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-39bdb15d-2819-4b2d-b472-5987e3a99bfc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:59.653817 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-39bdb15d-2819-4b2d-b472-5987e3a99bfc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:33:59.654936 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-39bdb15d-2819-4b2d-b472-5987e3a99bfc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.153430 Sep 03 01:33:59.655749 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 96/195] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:33:59 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:33:59.883609 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bba61757-9c0b-4bb8-b5e0-24c36c0c8fe7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:59.884162 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bba61757-9c0b-4bb8-b5e0-24c36c0c8fe7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:59.890103 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bba61757-9c0b-4bb8-b5e0-24c36c0c8fe7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:59.890624 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bba61757-9c0b-4bb8-b5e0-24c36c0c8fe7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:59.891059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bba61757-9c0b-4bb8-b5e0-24c36c0c8fe7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:59.891743 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bba61757-9c0b-4bb8-b5e0-24c36c0c8fe7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:59.892195 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bba61757-9c0b-4bb8-b5e0-24c36c0c8fe7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:59.892617 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bba61757-9c0b-4bb8-b5e0-24c36c0c8fe7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:59.928047 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-1a50c833-21c9-4550-968f-1704df09d58d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:33:59.928761 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-1a50c833-21c9-4550-968f-1704df09d58d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:33:59.935727 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1a50c833-21c9-4550-968f-1704df09d58d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:59.936298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1a50c833-21c9-4550-968f-1704df09d58d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:59.936821 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1a50c833-21c9-4550-968f-1704df09d58d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:33:59.937562 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1a50c833-21c9-4550-968f-1704df09d58d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:33:59.938006 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1a50c833-21c9-4550-968f-1704df09d58d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:33:59.938482 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1a50c833-21c9-4550-968f-1704df09d58d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:00.024036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bba61757-9c0b-4bb8-b5e0-24c36c0c8fe7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:00.032106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bba61757-9c0b-4bb8-b5e0-24c36c0c8fe7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.153141 Sep 03 01:34:00.032676 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 100/196] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:59 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:00.075629 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1a50c833-21c9-4550-968f-1704df09d58d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:00.083162 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-1a50c833-21c9-4550-968f-1704df09d58d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.159054 Sep 03 01:34:00.083735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 97/197] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:33:59 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:00.321290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8620d8ba-8fea-4cf9-8d2d-430f0eb0fa6e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:00.321889 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8620d8ba-8fea-4cf9-8d2d-430f0eb0fa6e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:00.328036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8620d8ba-8fea-4cf9-8d2d-430f0eb0fa6e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:00.328498 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8620d8ba-8fea-4cf9-8d2d-430f0eb0fa6e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:00.328928 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8620d8ba-8fea-4cf9-8d2d-430f0eb0fa6e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:00.329655 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8620d8ba-8fea-4cf9-8d2d-430f0eb0fa6e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:00.330150 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8620d8ba-8fea-4cf9-8d2d-430f0eb0fa6e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:00.330590 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8620d8ba-8fea-4cf9-8d2d-430f0eb0fa6e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:00.458486 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8620d8ba-8fea-4cf9-8d2d-430f0eb0fa6e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:00.466306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8620d8ba-8fea-4cf9-8d2d-430f0eb0fa6e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.149541 Sep 03 01:34:00.466907 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 101/198] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:00 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:00.532833 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6c99455b-0d8d-4ec2-93e2-50e491a51fd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:00.533432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6c99455b-0d8d-4ec2-93e2-50e491a51fd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:00.539823 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6c99455b-0d8d-4ec2-93e2-50e491a51fd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:00.540296 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6c99455b-0d8d-4ec2-93e2-50e491a51fd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:00.540725 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6c99455b-0d8d-4ec2-93e2-50e491a51fd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:00.541395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6c99455b-0d8d-4ec2-93e2-50e491a51fd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:00.541839 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6c99455b-0d8d-4ec2-93e2-50e491a51fd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:00.542254 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6c99455b-0d8d-4ec2-93e2-50e491a51fd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:00.681655 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2bb1b11b-2873-4c9f-b5b4-ecddee1f6273 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:00.682102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2bb1b11b-2873-4c9f-b5b4-ecddee1f6273 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:00.684106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6c99455b-0d8d-4ec2-93e2-50e491a51fd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:00.688241 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2bb1b11b-2873-4c9f-b5b4-ecddee1f6273 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:00.688722 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2bb1b11b-2873-4c9f-b5b4-ecddee1f6273 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:00.689157 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2bb1b11b-2873-4c9f-b5b4-ecddee1f6273 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:00.689850 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2bb1b11b-2873-4c9f-b5b4-ecddee1f6273 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:00.690299 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2bb1b11b-2873-4c9f-b5b4-ecddee1f6273 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:00.690741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2bb1b11b-2873-4c9f-b5b4-ecddee1f6273 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:00.691962 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6c99455b-0d8d-4ec2-93e2-50e491a51fd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.163088 Sep 03 01:34:00.692534 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 98/199] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:00 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:00.822220 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2bb1b11b-2873-4c9f-b5b4-ecddee1f6273 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:00.830857 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2bb1b11b-2873-4c9f-b5b4-ecddee1f6273 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:00.832360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2bb1b11b-2873-4c9f-b5b4-ecddee1f6273 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:00.833462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2bb1b11b-2873-4c9f-b5b4-ecddee1f6273 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.156699 Sep 03 01:34:00.834027 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 102/200] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:34:00 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:34:01.055207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-bba0e7c1-63c5-4a97-be72-71ac57e3143b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:01.055821 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-bba0e7c1-63c5-4a97-be72-71ac57e3143b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:01.062046 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bba0e7c1-63c5-4a97-be72-71ac57e3143b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:01.062507 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bba0e7c1-63c5-4a97-be72-71ac57e3143b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:01.062944 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bba0e7c1-63c5-4a97-be72-71ac57e3143b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:01.063647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bba0e7c1-63c5-4a97-be72-71ac57e3143b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:01.064098 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bba0e7c1-63c5-4a97-be72-71ac57e3143b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:01.064522 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bba0e7c1-63c5-4a97-be72-71ac57e3143b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:01.107410 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b396e712-408d-4ca0-bc23-85bf63e42b08 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:01.108105 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b396e712-408d-4ca0-bc23-85bf63e42b08 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:01.114474 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b396e712-408d-4ca0-bc23-85bf63e42b08 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:01.114967 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b396e712-408d-4ca0-bc23-85bf63e42b08 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:01.115405 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b396e712-408d-4ca0-bc23-85bf63e42b08 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:01.116314 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b396e712-408d-4ca0-bc23-85bf63e42b08 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:01.116771 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b396e712-408d-4ca0-bc23-85bf63e42b08 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:01.117200 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b396e712-408d-4ca0-bc23-85bf63e42b08 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:01.121488 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=100 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:01.204176 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bba0e7c1-63c5-4a97-be72-71ac57e3143b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:01.212809 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-bba0e7c1-63c5-4a97-be72-71ac57e3143b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1314 microversion: 2.1 time: 0.161849 Sep 03 01:34:01.220140 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 99/201] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:01 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:01.253946 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b396e712-408d-4ca0-bc23-85bf63e42b08 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:01.261840 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b396e712-408d-4ca0-bc23-85bf63e42b08 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.158752 Sep 03 01:34:01.262430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 103/202] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:01 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:01.491645 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-93cf41fa-aa62-4f74-8bfc-3ee138de630f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:01.492435 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-93cf41fa-aa62-4f74-8bfc-3ee138de630f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:01.499557 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-93cf41fa-aa62-4f74-8bfc-3ee138de630f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:01.500122 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-93cf41fa-aa62-4f74-8bfc-3ee138de630f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:01.500610 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-93cf41fa-aa62-4f74-8bfc-3ee138de630f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:01.501395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-93cf41fa-aa62-4f74-8bfc-3ee138de630f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:01.501871 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-93cf41fa-aa62-4f74-8bfc-3ee138de630f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:01.502369 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-93cf41fa-aa62-4f74-8bfc-3ee138de630f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:01.654183 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-93cf41fa-aa62-4f74-8bfc-3ee138de630f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:01.661685 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-93cf41fa-aa62-4f74-8bfc-3ee138de630f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1322 microversion: 2.1 time: 0.176003 Sep 03 01:34:01.662386 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 100/203] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:01 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:01.717361 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-62327caf-c99c-4182-9287-671245a53946 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:01.717968 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-62327caf-c99c-4182-9287-671245a53946 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:01.724034 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62327caf-c99c-4182-9287-671245a53946 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:01.724506 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62327caf-c99c-4182-9287-671245a53946 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:01.724998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62327caf-c99c-4182-9287-671245a53946 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:01.726307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62327caf-c99c-4182-9287-671245a53946 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:01.726775 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62327caf-c99c-4182-9287-671245a53946 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:01.727198 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62327caf-c99c-4182-9287-671245a53946 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:01.861167 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-54d31906-ce5f-43e6-bcb2-5a12494fc789 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:01.862019 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-54d31906-ce5f-43e6-bcb2-5a12494fc789 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:01.862479 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-62327caf-c99c-4182-9287-671245a53946 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:01.868731 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54d31906-ce5f-43e6-bcb2-5a12494fc789 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:01.869354 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54d31906-ce5f-43e6-bcb2-5a12494fc789 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:01.869794 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54d31906-ce5f-43e6-bcb2-5a12494fc789 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:01.870524 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54d31906-ce5f-43e6-bcb2-5a12494fc789 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:01.870978 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54d31906-ce5f-43e6-bcb2-5a12494fc789 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:01.871400 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54d31906-ce5f-43e6-bcb2-5a12494fc789 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:01.873799 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-62327caf-c99c-4182-9287-671245a53946 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.158515 Sep 03 01:34:01.874789 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 104/204] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:01 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:02.026310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-54d31906-ce5f-43e6-bcb2-5a12494fc789 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:02.041748 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-54d31906-ce5f-43e6-bcb2-5a12494fc789 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:02.041748 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-54d31906-ce5f-43e6-bcb2-5a12494fc789 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:02.041748 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-54d31906-ce5f-43e6-bcb2-5a12494fc789 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.183194 Sep 03 01:34:02.042089 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 101/205] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:34:01 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:34:02.238131 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-37897a6d-24f7-48dd-a708-1e2b29785ff8 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:02.238670 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-37897a6d-24f7-48dd-a708-1e2b29785ff8 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:02.246301 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37897a6d-24f7-48dd-a708-1e2b29785ff8 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:02.246813 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37897a6d-24f7-48dd-a708-1e2b29785ff8 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:02.247420 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37897a6d-24f7-48dd-a708-1e2b29785ff8 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:02.248111 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37897a6d-24f7-48dd-a708-1e2b29785ff8 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:02.248662 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37897a6d-24f7-48dd-a708-1e2b29785ff8 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:02.249085 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37897a6d-24f7-48dd-a708-1e2b29785ff8 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:02.263396 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-0ba8dc69-2436-4492-96ad-28b61b0b4e81 req-1f7e67c2-c02e-4a27-8119-ce7bb2879063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fef20f-3dfd-4d65-b5ed-50f3caaa011f", "name": "network-vif-plugged", "status": "completed", "tag": "e8b8b19d-91b5-4b5a-a71d-5c995462d419"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:02.275127 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-0ba8dc69-2436-4492-96ad-28b61b0b4e81 req-1f7e67c2-c02e-4a27-8119-ce7bb2879063 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:02.275650 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-0ba8dc69-2436-4492-96ad-28b61b0b4e81 req-1f7e67c2-c02e-4a27-8119-ce7bb2879063 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:02.276088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-0ba8dc69-2436-4492-96ad-28b61b0b4e81 req-1f7e67c2-c02e-4a27-8119-ce7bb2879063 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:02.291523 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-0ba8dc69-2436-4492-96ad-28b61b0b4e81 req-1f7e67c2-c02e-4a27-8119-ce7bb2879063 service nova] Creating event network-vif-plugged:e8b8b19d-91b5-4b5a-a71d-5c995462d419 for instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f on hv-cinder-83800 Sep 03 01:34:02.297348 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-0ba8dc69-2436-4492-96ad-28b61b0b4e81 req-1f7e67c2-c02e-4a27-8119-ce7bb2879063 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037548 Sep 03 01:34:02.297877 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 102/206] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:34:02.303472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9caf704c-2e1e-452c-924a-b28991d8cdab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:02.304244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9caf704c-2e1e-452c-924a-b28991d8cdab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:02.310975 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9caf704c-2e1e-452c-924a-b28991d8cdab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:02.311067 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9caf704c-2e1e-452c-924a-b28991d8cdab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:02.311782 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9caf704c-2e1e-452c-924a-b28991d8cdab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:02.312477 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9caf704c-2e1e-452c-924a-b28991d8cdab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:02.313060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9caf704c-2e1e-452c-924a-b28991d8cdab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:02.313344 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9caf704c-2e1e-452c-924a-b28991d8cdab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:02.416356 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-37897a6d-24f7-48dd-a708-1e2b29785ff8 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:02.426652 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-37897a6d-24f7-48dd-a708-1e2b29785ff8 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1501 microversion: 2.1 time: 0.194274 Sep 03 01:34:02.428061 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 105/207] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:02 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1501 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:02.509756 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9caf704c-2e1e-452c-924a-b28991d8cdab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:02.518615 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9caf704c-2e1e-452c-924a-b28991d8cdab tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.219465 Sep 03 01:34:02.520250 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 103/208] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:02 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:02.685011 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-714256ff-faaa-457e-b791-36c6bb5f6bb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:02.685609 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-714256ff-faaa-457e-b791-36c6bb5f6bb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:02.691467 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-714256ff-faaa-457e-b791-36c6bb5f6bb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:02.691994 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-714256ff-faaa-457e-b791-36c6bb5f6bb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:02.692427 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-714256ff-faaa-457e-b791-36c6bb5f6bb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:02.693119 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-714256ff-faaa-457e-b791-36c6bb5f6bb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:02.694268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-714256ff-faaa-457e-b791-36c6bb5f6bb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:02.695052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-714256ff-faaa-457e-b791-36c6bb5f6bb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:02.886638 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-714256ff-faaa-457e-b791-36c6bb5f6bb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:02.906127 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-714256ff-faaa-457e-b791-36c6bb5f6bb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1515 microversion: 2.1 time: 0.224608 Sep 03 01:34:02.910054 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-99a64125-d7bb-4943-9c28-126b6e372c5d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:02.910982 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-99a64125-d7bb-4943-9c28-126b6e372c5d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:02.918689 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-99a64125-d7bb-4943-9c28-126b6e372c5d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:02.919157 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 106/209] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:02 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:02.921549 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-99a64125-d7bb-4943-9c28-126b6e372c5d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:02.921549 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-99a64125-d7bb-4943-9c28-126b6e372c5d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:02.921549 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-99a64125-d7bb-4943-9c28-126b6e372c5d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:02.921820 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-99a64125-d7bb-4943-9c28-126b6e372c5d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:02.923293 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-99a64125-d7bb-4943-9c28-126b6e372c5d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:02.932547 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-89744420-261e-4225-a6cf-bfd0ed97304f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:02.935652 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-89744420-261e-4225-a6cf-bfd0ed97304f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:02.943498 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-89744420-261e-4225-a6cf-bfd0ed97304f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:02.944796 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-89744420-261e-4225-a6cf-bfd0ed97304f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:02.946576 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-89744420-261e-4225-a6cf-bfd0ed97304f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:02.946576 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-89744420-261e-4225-a6cf-bfd0ed97304f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:02.946576 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-89744420-261e-4225-a6cf-bfd0ed97304f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:02.947064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-89744420-261e-4225-a6cf-bfd0ed97304f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:03.016915 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-89744420-261e-4225-a6cf-bfd0ed97304f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lazy-loading 'flavor' on Instance uuid 615f8d7e-2e14-4015-a24f-2b02e885ef44 {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:34:03.076626 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-99a64125-d7bb-4943-9c28-126b6e372c5d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:03.084296 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-99a64125-d7bb-4943-9c28-126b6e372c5d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.191042 Sep 03 01:34:03.084891 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 104/210] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:02 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:03.089671 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2a92b717-c745-40aa-89b3-4796272d66c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:03.090276 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2a92b717-c745-40aa-89b3-4796272d66c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:03.096119 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2a92b717-c745-40aa-89b3-4796272d66c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:03.101065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2a92b717-c745-40aa-89b3-4796272d66c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:03.101065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2a92b717-c745-40aa-89b3-4796272d66c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:03.101065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2a92b717-c745-40aa-89b3-4796272d66c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:03.101065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2a92b717-c745-40aa-89b3-4796272d66c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:03.101393 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2a92b717-c745-40aa-89b3-4796272d66c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:03.123211 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:03.307320 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2a92b717-c745-40aa-89b3-4796272d66c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:03.317618 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2a92b717-c745-40aa-89b3-4796272d66c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:03.322411 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2a92b717-c745-40aa-89b3-4796272d66c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:03.325132 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2a92b717-c745-40aa-89b3-4796272d66c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.238882 Sep 03 01:34:03.325902 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 105/211] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:34:03 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:34:03.438361 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-89744420-261e-4225-a6cf-bfd0ed97304f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "POST /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44/action" status: 200 len: 32 microversion: 2.1 time: 0.511439 Sep 03 01:34:03.439095 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 107/212] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:34:02 2022] POST /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44/action => generated 32 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 01:34:03.452789 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f9795d54-934c-463c-a6e4-4af77123e971 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:03.452789 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f9795d54-934c-463c-a6e4-4af77123e971 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:03.458167 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9795d54-934c-463c-a6e4-4af77123e971 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:03.458941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9795d54-934c-463c-a6e4-4af77123e971 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:03.459570 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9795d54-934c-463c-a6e4-4af77123e971 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:03.460263 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9795d54-934c-463c-a6e4-4af77123e971 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:03.461086 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9795d54-934c-463c-a6e4-4af77123e971 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:03.462782 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9795d54-934c-463c-a6e4-4af77123e971 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:03.544965 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7e4dd299-b11b-42ed-a517-952e6bb5194b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:03.545870 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7e4dd299-b11b-42ed-a517-952e6bb5194b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:03.552513 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7e4dd299-b11b-42ed-a517-952e6bb5194b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:03.553200 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7e4dd299-b11b-42ed-a517-952e6bb5194b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:03.553765 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7e4dd299-b11b-42ed-a517-952e6bb5194b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:03.555603 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7e4dd299-b11b-42ed-a517-952e6bb5194b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:03.556129 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7e4dd299-b11b-42ed-a517-952e6bb5194b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:03.557366 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7e4dd299-b11b-42ed-a517-952e6bb5194b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:03.722011 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f9795d54-934c-463c-a6e4-4af77123e971 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:03.722217 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7e4dd299-b11b-42ed-a517-952e6bb5194b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:03.730691 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f9795d54-934c-463c-a6e4-4af77123e971 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.285399 Sep 03 01:34:03.731287 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 106/213] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:03 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:03.743036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7e4dd299-b11b-42ed-a517-952e6bb5194b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.190426 Sep 03 01:34:03.743036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 108/214] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:03 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:04.106974 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-90406212-7bfa-457d-8793-de5a2d5eff4c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:04.107493 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-90406212-7bfa-457d-8793-de5a2d5eff4c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:04.113346 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-90406212-7bfa-457d-8793-de5a2d5eff4c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:04.114205 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-90406212-7bfa-457d-8793-de5a2d5eff4c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:04.114663 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-90406212-7bfa-457d-8793-de5a2d5eff4c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:04.115337 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-90406212-7bfa-457d-8793-de5a2d5eff4c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:04.116322 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-90406212-7bfa-457d-8793-de5a2d5eff4c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:04.116754 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-90406212-7bfa-457d-8793-de5a2d5eff4c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:04.246999 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-90406212-7bfa-457d-8793-de5a2d5eff4c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:04.254623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-90406212-7bfa-457d-8793-de5a2d5eff4c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.151531 Sep 03 01:34:04.255213 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 107/215] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:04 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:04.313688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-41239a0e-a16c-484a-8f34-684170aa06c5 req-b741681c-3f19-4d5d-a98a-bf199fd56b55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb", "name": "network-vif-plugged", "status": "completed", "tag": "fc3e436d-fb1a-441d-bc04-3d6a3d3a5bc4"}, {"server_uuid": "329ea656-c337-4f07-bd3d-9f67c4d6418e", "name": "network-vif-plugged", "status": "completed", "tag": "8e331545-f680-453c-942e-5cd9fc274b5f"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:04.329104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-41239a0e-a16c-484a-8f34-684170aa06c5 req-b741681c-3f19-4d5d-a98a-bf199fd56b55 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:04.329782 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-41239a0e-a16c-484a-8f34-684170aa06c5 req-b741681c-3f19-4d5d-a98a-bf199fd56b55 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:04.330561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-41239a0e-a16c-484a-8f34-684170aa06c5 req-b741681c-3f19-4d5d-a98a-bf199fd56b55 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:04.354013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-94f3337c-2928-4b3e-be80-6f822e4bf601 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:04.355153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-94f3337c-2928-4b3e-be80-6f822e4bf601 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:04.355544 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-41239a0e-a16c-484a-8f34-684170aa06c5 req-b741681c-3f19-4d5d-a98a-bf199fd56b55 service nova] Creating event network-vif-plugged:fc3e436d-fb1a-441d-bc04-3d6a3d3a5bc4 for instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb on hv-cinder-83800 Sep 03 01:34:04.356187 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-41239a0e-a16c-484a-8f34-684170aa06c5 req-b741681c-3f19-4d5d-a98a-bf199fd56b55 service nova] Creating event network-vif-plugged:8e331545-f680-453c-942e-5cd9fc274b5f for instance 329ea656-c337-4f07-bd3d-9f67c4d6418e on hv-cinder-83800 Sep 03 01:34:04.361752 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-94f3337c-2928-4b3e-be80-6f822e4bf601 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:04.362747 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-94f3337c-2928-4b3e-be80-6f822e4bf601 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:04.363369 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-94f3337c-2928-4b3e-be80-6f822e4bf601 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:04.364541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-94f3337c-2928-4b3e-be80-6f822e4bf601 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:04.364840 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-41239a0e-a16c-484a-8f34-684170aa06c5 req-b741681c-3f19-4d5d-a98a-bf199fd56b55 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.056263 Sep 03 01:34:04.365579 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-94f3337c-2928-4b3e-be80-6f822e4bf601 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:04.367090 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-94f3337c-2928-4b3e-be80-6f822e4bf601 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:04.370364 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 109/216] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:34:04.396073 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a03ee6cf-6490-4c84-b10b-22cfefe552e7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1df631ca-1262-4e4b-96b6-44729e539369"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:04.400746 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a03ee6cf-6490-4c84-b10b-22cfefe552e7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:04.409241 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a03ee6cf-6490-4c84-b10b-22cfefe552e7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:04.409735 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a03ee6cf-6490-4c84-b10b-22cfefe552e7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:04.410267 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a03ee6cf-6490-4c84-b10b-22cfefe552e7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:04.411348 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a03ee6cf-6490-4c84-b10b-22cfefe552e7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:04.412042 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a03ee6cf-6490-4c84-b10b-22cfefe552e7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:04.413028 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a03ee6cf-6490-4c84-b10b-22cfefe552e7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:04.567298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-94f3337c-2928-4b3e-be80-6f822e4bf601 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:04.575794 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-94f3337c-2928-4b3e-be80-6f822e4bf601 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:04.577233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-94f3337c-2928-4b3e-be80-6f822e4bf601 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:04.578332 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-94f3337c-2928-4b3e-be80-6f822e4bf601 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.229031 Sep 03 01:34:04.578911 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 108/217] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:34:04 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:34:04.754027 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cee6e029-b51f-4101-ae46-cbe14e3b3690 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:04.754719 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cee6e029-b51f-4101-ae46-cbe14e3b3690 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:04.761054 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cee6e029-b51f-4101-ae46-cbe14e3b3690 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:04.761535 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cee6e029-b51f-4101-ae46-cbe14e3b3690 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:04.761973 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cee6e029-b51f-4101-ae46-cbe14e3b3690 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:04.762685 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cee6e029-b51f-4101-ae46-cbe14e3b3690 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:04.763144 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cee6e029-b51f-4101-ae46-cbe14e3b3690 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:04.763567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cee6e029-b51f-4101-ae46-cbe14e3b3690 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:04.893188 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cee6e029-b51f-4101-ae46-cbe14e3b3690 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:04.901610 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cee6e029-b51f-4101-ae46-cbe14e3b3690 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.151369 Sep 03 01:34:04.902183 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 109/218] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:04 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:04.907138 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a0028f92-dc8d-4a34-b100-320ed424467c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:04.907770 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a0028f92-dc8d-4a34-b100-320ed424467c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:04.913808 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0028f92-dc8d-4a34-b100-320ed424467c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:04.914292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0028f92-dc8d-4a34-b100-320ed424467c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:04.914746 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0028f92-dc8d-4a34-b100-320ed424467c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:04.915565 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0028f92-dc8d-4a34-b100-320ed424467c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:04.916014 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0028f92-dc8d-4a34-b100-320ed424467c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:04.916433 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0028f92-dc8d-4a34-b100-320ed424467c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:05.048214 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a0028f92-dc8d-4a34-b100-320ed424467c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:05.055951 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a0028f92-dc8d-4a34-b100-320ed424467c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.152643 Sep 03 01:34:05.056494 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 110/219] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:04 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:05.278081 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e50f9ad8-59dc-4459-8e4b-217743dc0eee tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:05.279118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e50f9ad8-59dc-4459-8e4b-217743dc0eee tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:05.286582 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e50f9ad8-59dc-4459-8e4b-217743dc0eee tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:05.287056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e50f9ad8-59dc-4459-8e4b-217743dc0eee tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:05.287491 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e50f9ad8-59dc-4459-8e4b-217743dc0eee tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:05.288187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e50f9ad8-59dc-4459-8e4b-217743dc0eee tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:05.288634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e50f9ad8-59dc-4459-8e4b-217743dc0eee tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:05.289184 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e50f9ad8-59dc-4459-8e4b-217743dc0eee tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:05.424633 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e50f9ad8-59dc-4459-8e4b-217743dc0eee tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:05.432346 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e50f9ad8-59dc-4459-8e4b-217743dc0eee tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.158071 Sep 03 01:34:05.432912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 111/220] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:05 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:05.606785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-88b6894f-b42d-4d87-b642-3c705eb08d5a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:05.607955 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-88b6894f-b42d-4d87-b642-3c705eb08d5a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:05.615179 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-88b6894f-b42d-4d87-b642-3c705eb08d5a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:05.658499 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-88b6894f-b42d-4d87-b642-3c705eb08d5a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:05.658499 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-88b6894f-b42d-4d87-b642-3c705eb08d5a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:05.658499 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-88b6894f-b42d-4d87-b642-3c705eb08d5a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:05.658499 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-88b6894f-b42d-4d87-b642-3c705eb08d5a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:05.659208 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-88b6894f-b42d-4d87-b642-3c705eb08d5a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:05.776329 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-88b6894f-b42d-4d87-b642-3c705eb08d5a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:05.785537 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-88b6894f-b42d-4d87-b642-3c705eb08d5a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:05.787080 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-88b6894f-b42d-4d87-b642-3c705eb08d5a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:05.788317 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-88b6894f-b42d-4d87-b642-3c705eb08d5a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.187000 Sep 03 01:34:05.791922 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 112/221] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:34:05 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:34:05.924772 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-71ffb881-cdaa-413d-ba3c-d44a8c11056d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:05.925307 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-71ffb881-cdaa-413d-ba3c-d44a8c11056d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:05.931676 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71ffb881-cdaa-413d-ba3c-d44a8c11056d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:05.932161 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71ffb881-cdaa-413d-ba3c-d44a8c11056d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:05.932597 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71ffb881-cdaa-413d-ba3c-d44a8c11056d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:05.933272 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71ffb881-cdaa-413d-ba3c-d44a8c11056d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:05.933720 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71ffb881-cdaa-413d-ba3c-d44a8c11056d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:05.934156 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71ffb881-cdaa-413d-ba3c-d44a8c11056d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:06.093628 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-71ffb881-cdaa-413d-ba3c-d44a8c11056d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:06.101472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-71ffb881-cdaa-413d-ba3c-d44a8c11056d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.180627 Sep 03 01:34:06.106809 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 113/222] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:05 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:06.106809 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a55fd786-81b2-43b1-b33b-a7171cfca481 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:06.107015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a55fd786-81b2-43b1-b33b-a7171cfca481 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:06.112679 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a55fd786-81b2-43b1-b33b-a7171cfca481 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:06.113158 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a55fd786-81b2-43b1-b33b-a7171cfca481 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:06.113593 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a55fd786-81b2-43b1-b33b-a7171cfca481 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:06.114385 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a55fd786-81b2-43b1-b33b-a7171cfca481 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:06.114836 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a55fd786-81b2-43b1-b33b-a7171cfca481 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:06.115259 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a55fd786-81b2-43b1-b33b-a7171cfca481 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:06.245589 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a55fd786-81b2-43b1-b33b-a7171cfca481 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:06.253219 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a55fd786-81b2-43b1-b33b-a7171cfca481 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.150235 Sep 03 01:34:06.257749 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 114/223] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:06 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:06.455686 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-98df075d-df9a-457a-897a-e31882504a3f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:06.456323 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-98df075d-df9a-457a-897a-e31882504a3f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:06.462238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-98df075d-df9a-457a-897a-e31882504a3f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:06.462741 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-98df075d-df9a-457a-897a-e31882504a3f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:06.463174 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-98df075d-df9a-457a-897a-e31882504a3f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:06.463853 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-98df075d-df9a-457a-897a-e31882504a3f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:06.464297 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-98df075d-df9a-457a-897a-e31882504a3f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:06.464713 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-98df075d-df9a-457a-897a-e31882504a3f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:06.591138 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-98df075d-df9a-457a-897a-e31882504a3f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:06.598681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-98df075d-df9a-457a-897a-e31882504a3f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.146889 Sep 03 01:34:06.599251 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 115/224] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:06 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:06.813149 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-906b3437-e495-48e8-9afb-dacc45688ceb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:06.813751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-906b3437-e495-48e8-9afb-dacc45688ceb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:06.819962 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-906b3437-e495-48e8-9afb-dacc45688ceb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:06.820438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-906b3437-e495-48e8-9afb-dacc45688ceb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:06.820873 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-906b3437-e495-48e8-9afb-dacc45688ceb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:06.821557 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-906b3437-e495-48e8-9afb-dacc45688ceb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:06.822007 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-906b3437-e495-48e8-9afb-dacc45688ceb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:06.822456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-906b3437-e495-48e8-9afb-dacc45688ceb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:06.953863 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-906b3437-e495-48e8-9afb-dacc45688ceb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:06.962677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-906b3437-e495-48e8-9afb-dacc45688ceb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:06.965846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-906b3437-e495-48e8-9afb-dacc45688ceb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:06.965846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-906b3437-e495-48e8-9afb-dacc45688ceb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.155996 Sep 03 01:34:06.965846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 116/225] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:34:06 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:34:07.126149 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2db87537-4c91-42e1-ba44-656b17849c01 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:07.126877 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2db87537-4c91-42e1-ba44-656b17849c01 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:07.130234 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:07.134709 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2db87537-4c91-42e1-ba44-656b17849c01 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:07.135194 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2db87537-4c91-42e1-ba44-656b17849c01 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:07.135634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2db87537-4c91-42e1-ba44-656b17849c01 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:07.136323 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2db87537-4c91-42e1-ba44-656b17849c01 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:07.136779 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2db87537-4c91-42e1-ba44-656b17849c01 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:07.137201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2db87537-4c91-42e1-ba44-656b17849c01 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:07.308732 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2db87537-4c91-42e1-ba44-656b17849c01 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:07.316620 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2db87537-4c91-42e1-ba44-656b17849c01 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.194975 Sep 03 01:34:07.317120 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 117/226] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:07 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:07.322404 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-227a6795-5999-42f8-9ea3-eac369f1bedd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:07.323004 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-227a6795-5999-42f8-9ea3-eac369f1bedd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:07.328763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-227a6795-5999-42f8-9ea3-eac369f1bedd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:07.329239 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-227a6795-5999-42f8-9ea3-eac369f1bedd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:07.329854 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-227a6795-5999-42f8-9ea3-eac369f1bedd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:07.330569 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-227a6795-5999-42f8-9ea3-eac369f1bedd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:07.331023 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-227a6795-5999-42f8-9ea3-eac369f1bedd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:07.331449 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-227a6795-5999-42f8-9ea3-eac369f1bedd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:07.504085 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-227a6795-5999-42f8-9ea3-eac369f1bedd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:07.512392 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-227a6795-5999-42f8-9ea3-eac369f1bedd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.194295 Sep 03 01:34:07.512975 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 118/227] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:07 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:07.627377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cef11322-3a25-48db-a9da-7e91bf18a9d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:07.627881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cef11322-3a25-48db-a9da-7e91bf18a9d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:07.634962 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cef11322-3a25-48db-a9da-7e91bf18a9d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:07.635432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cef11322-3a25-48db-a9da-7e91bf18a9d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:07.635863 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cef11322-3a25-48db-a9da-7e91bf18a9d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:07.636559 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cef11322-3a25-48db-a9da-7e91bf18a9d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:07.637007 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cef11322-3a25-48db-a9da-7e91bf18a9d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:07.637426 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cef11322-3a25-48db-a9da-7e91bf18a9d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:07.770517 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cef11322-3a25-48db-a9da-7e91bf18a9d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:07.778288 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cef11322-3a25-48db-a9da-7e91bf18a9d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.154885 Sep 03 01:34:07.778882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 119/228] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:07 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:07.992836 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-28c53495-53e7-4fc9-9c26-acd5c2142921 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:07.994325 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-28c53495-53e7-4fc9-9c26-acd5c2142921 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:08.000695 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-28c53495-53e7-4fc9-9c26-acd5c2142921 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:08.008889 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-28c53495-53e7-4fc9-9c26-acd5c2142921 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:08.008889 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-28c53495-53e7-4fc9-9c26-acd5c2142921 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:08.008889 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-28c53495-53e7-4fc9-9c26-acd5c2142921 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:08.008889 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-28c53495-53e7-4fc9-9c26-acd5c2142921 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:08.009610 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-28c53495-53e7-4fc9-9c26-acd5c2142921 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:08.193497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-28c53495-53e7-4fc9-9c26-acd5c2142921 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:08.203113 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-28c53495-53e7-4fc9-9c26-acd5c2142921 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:08.204558 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-28c53495-53e7-4fc9-9c26-acd5c2142921 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:08.205795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-28c53495-53e7-4fc9-9c26-acd5c2142921 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.218719 Sep 03 01:34:08.206517 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 120/229] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:34:07 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:34:08.355797 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a982b017-612c-443a-a047-6ceb23dc7a94 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:08.356720 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a982b017-612c-443a-a047-6ceb23dc7a94 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:08.363806 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a982b017-612c-443a-a047-6ceb23dc7a94 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:08.364751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a982b017-612c-443a-a047-6ceb23dc7a94 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:08.365308 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a982b017-612c-443a-a047-6ceb23dc7a94 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:08.366306 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a982b017-612c-443a-a047-6ceb23dc7a94 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:08.367251 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a982b017-612c-443a-a047-6ceb23dc7a94 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:08.368095 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a982b017-612c-443a-a047-6ceb23dc7a94 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:08.508687 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a982b017-612c-443a-a047-6ceb23dc7a94 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:08.516500 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a982b017-612c-443a-a047-6ceb23dc7a94 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1363 microversion: 2.1 time: 0.167604 Sep 03 01:34:08.517069 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 121/230] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:08 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:08.534080 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a03ee6cf-6490-4c84-b10b-22cfefe552e7 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "POST /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.145573 Sep 03 01:34:08.535343 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 110/231] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:34:04 2022] POST /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad/os-volume_attachments => generated 194 bytes in 4148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:34:08.536003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-aacb0a90-b208-437b-a314-68419a17c6ea tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:08.536775 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-aacb0a90-b208-437b-a314-68419a17c6ea tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:08.543891 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aacb0a90-b208-437b-a314-68419a17c6ea tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:08.544515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aacb0a90-b208-437b-a314-68419a17c6ea tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:08.544949 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aacb0a90-b208-437b-a314-68419a17c6ea tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:08.545642 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aacb0a90-b208-437b-a314-68419a17c6ea tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:08.546081 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aacb0a90-b208-437b-a314-68419a17c6ea tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:08.546524 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aacb0a90-b208-437b-a314-68419a17c6ea tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:08.550784 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:08.686897 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-aacb0a90-b208-437b-a314-68419a17c6ea tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:08.694597 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-aacb0a90-b208-437b-a314-68419a17c6ea tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.163858 Sep 03 01:34:08.695174 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 122/232] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:08 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:08.805613 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-16f7f75a-9bf9-4e43-b8d8-0fa3b76337cf tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:08.806980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-16f7f75a-9bf9-4e43-b8d8-0fa3b76337cf tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:08.813782 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-16f7f75a-9bf9-4e43-b8d8-0fa3b76337cf tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:08.814271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-16f7f75a-9bf9-4e43-b8d8-0fa3b76337cf tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:08.814731 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-16f7f75a-9bf9-4e43-b8d8-0fa3b76337cf tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:08.815424 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-16f7f75a-9bf9-4e43-b8d8-0fa3b76337cf tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:08.815867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-16f7f75a-9bf9-4e43-b8d8-0fa3b76337cf tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:08.816281 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-16f7f75a-9bf9-4e43-b8d8-0fa3b76337cf tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:08.945364 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-16f7f75a-9bf9-4e43-b8d8-0fa3b76337cf tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:08.953191 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-16f7f75a-9bf9-4e43-b8d8-0fa3b76337cf tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.152942 Sep 03 01:34:08.953794 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 111/233] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:08 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:09.237046 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7053fccb-5e63-4bc5-a8f0-44a82f4148fc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:09.237562 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7053fccb-5e63-4bc5-a8f0-44a82f4148fc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:09.244288 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7053fccb-5e63-4bc5-a8f0-44a82f4148fc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:09.244761 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7053fccb-5e63-4bc5-a8f0-44a82f4148fc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:09.245841 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7053fccb-5e63-4bc5-a8f0-44a82f4148fc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:09.246594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7053fccb-5e63-4bc5-a8f0-44a82f4148fc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:09.247098 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7053fccb-5e63-4bc5-a8f0-44a82f4148fc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:09.247521 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7053fccb-5e63-4bc5-a8f0-44a82f4148fc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:09.385148 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7053fccb-5e63-4bc5-a8f0-44a82f4148fc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:09.393534 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7053fccb-5e63-4bc5-a8f0-44a82f4148fc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:09.394803 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7053fccb-5e63-4bc5-a8f0-44a82f4148fc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:09.395913 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7053fccb-5e63-4bc5-a8f0-44a82f4148fc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.162908 Sep 03 01:34:09.396500 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 123/234] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:34:09 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:34:09.541751 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-63ab2d59-0bd6-4d46-9f86-211d7afd6e83 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:09.543074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-63ab2d59-0bd6-4d46-9f86-211d7afd6e83 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:09.549483 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63ab2d59-0bd6-4d46-9f86-211d7afd6e83 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:09.553620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63ab2d59-0bd6-4d46-9f86-211d7afd6e83 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:09.553620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63ab2d59-0bd6-4d46-9f86-211d7afd6e83 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:09.553620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63ab2d59-0bd6-4d46-9f86-211d7afd6e83 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:09.553620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63ab2d59-0bd6-4d46-9f86-211d7afd6e83 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:09.553966 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63ab2d59-0bd6-4d46-9f86-211d7afd6e83 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:09.686865 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-63ab2d59-0bd6-4d46-9f86-211d7afd6e83 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:09.694517 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-63ab2d59-0bd6-4d46-9f86-211d7afd6e83 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1550 microversion: 2.1 time: 0.157211 Sep 03 01:34:09.695075 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 112/235] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:09 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1550 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:09.716980 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9c6c7d27-8c3c-47dc-a089-b788227f322d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:09.718142 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9c6c7d27-8c3c-47dc-a089-b788227f322d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:09.720949 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4f94c262-e5f4-44e3-adc1-8956b81f89d7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:09.721659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4f94c262-e5f4-44e3-adc1-8956b81f89d7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:09.725422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9c6c7d27-8c3c-47dc-a089-b788227f322d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:09.726057 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9c6c7d27-8c3c-47dc-a089-b788227f322d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:09.726826 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9c6c7d27-8c3c-47dc-a089-b788227f322d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:09.727598 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9c6c7d27-8c3c-47dc-a089-b788227f322d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:09.728128 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9c6c7d27-8c3c-47dc-a089-b788227f322d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:09.728619 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9c6c7d27-8c3c-47dc-a089-b788227f322d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:09.729115 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f94c262-e5f4-44e3-adc1-8956b81f89d7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:09.729744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f94c262-e5f4-44e3-adc1-8956b81f89d7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:09.730297 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f94c262-e5f4-44e3-adc1-8956b81f89d7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:09.735543 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f94c262-e5f4-44e3-adc1-8956b81f89d7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:09.735543 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f94c262-e5f4-44e3-adc1-8956b81f89d7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:09.735543 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f94c262-e5f4-44e3-adc1-8956b81f89d7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:09.812053 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4f94c262-e5f4-44e3-adc1-8956b81f89d7 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095395 Sep 03 01:34:09.812641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 113/236] 10.222.0.13 () {58 vars in 1275 bytes} [Sat Sep 3 01:34:09 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:34:09.978582 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-07f86de7-a960-4f38-ab60-5123d85330ea tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:09.979302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-07f86de7-a960-4f38-ab60-5123d85330ea tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:09.987858 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07f86de7-a960-4f38-ab60-5123d85330ea tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:09.988779 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07f86de7-a960-4f38-ab60-5123d85330ea tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:09.989299 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07f86de7-a960-4f38-ab60-5123d85330ea tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:09.990928 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07f86de7-a960-4f38-ab60-5123d85330ea tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:09.991785 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07f86de7-a960-4f38-ab60-5123d85330ea tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:09.992411 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07f86de7-a960-4f38-ab60-5123d85330ea tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:10.060227 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9c6c7d27-8c3c-47dc-a089-b788227f322d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:10.077791 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9c6c7d27-8c3c-47dc-a089-b788227f322d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.364647 Sep 03 01:34:10.078403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 124/237] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:09 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:10.141404 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-07f86de7-a960-4f38-ab60-5123d85330ea tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:10.149393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-07f86de7-a960-4f38-ab60-5123d85330ea tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.176707 Sep 03 01:34:10.149968 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 114/238] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:09 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:10.424366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9ff64451-ad6d-4b0a-8616-4c2ee2ad42e1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:10.424974 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9ff64451-ad6d-4b0a-8616-4c2ee2ad42e1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:10.431605 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9ff64451-ad6d-4b0a-8616-4c2ee2ad42e1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:10.432099 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9ff64451-ad6d-4b0a-8616-4c2ee2ad42e1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:10.432533 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9ff64451-ad6d-4b0a-8616-4c2ee2ad42e1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:10.433226 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9ff64451-ad6d-4b0a-8616-4c2ee2ad42e1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:10.433677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9ff64451-ad6d-4b0a-8616-4c2ee2ad42e1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:10.434094 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9ff64451-ad6d-4b0a-8616-4c2ee2ad42e1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:10.847771 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9ff64451-ad6d-4b0a-8616-4c2ee2ad42e1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:10.856526 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9ff64451-ad6d-4b0a-8616-4c2ee2ad42e1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:10.857943 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9ff64451-ad6d-4b0a-8616-4c2ee2ad42e1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:10.859071 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9ff64451-ad6d-4b0a-8616-4c2ee2ad42e1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.440993 Sep 03 01:34:10.859658 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 125/239] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:34:10 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:34:11.100559 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a3c03d73-9f47-47f6-a4e3-ddcc286c8ec1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:11.101073 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a3c03d73-9f47-47f6-a4e3-ddcc286c8ec1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:11.107538 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3c03d73-9f47-47f6-a4e3-ddcc286c8ec1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:11.108011 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3c03d73-9f47-47f6-a4e3-ddcc286c8ec1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:11.108439 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3c03d73-9f47-47f6-a4e3-ddcc286c8ec1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:11.109115 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3c03d73-9f47-47f6-a4e3-ddcc286c8ec1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:11.109565 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3c03d73-9f47-47f6-a4e3-ddcc286c8ec1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:11.109978 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3c03d73-9f47-47f6-a4e3-ddcc286c8ec1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:11.173669 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-bc0daa15-ee75-415c-ae13-db37ce65e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:11.174306 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-bc0daa15-ee75-415c-ae13-db37ce65e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:11.180594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bc0daa15-ee75-415c-ae13-db37ce65e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:11.181321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bc0daa15-ee75-415c-ae13-db37ce65e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:11.181754 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bc0daa15-ee75-415c-ae13-db37ce65e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:11.182467 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bc0daa15-ee75-415c-ae13-db37ce65e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:11.182914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bc0daa15-ee75-415c-ae13-db37ce65e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:11.183332 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bc0daa15-ee75-415c-ae13-db37ce65e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:11.251458 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a3c03d73-9f47-47f6-a4e3-ddcc286c8ec1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:11.260423 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a3c03d73-9f47-47f6-a4e3-ddcc286c8ec1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.163814 Sep 03 01:34:11.261047 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 115/240] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:11 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:11.401977 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bc0daa15-ee75-415c-ae13-db37ce65e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:11.404887 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-bbf8a15b-acc1-4a70-a309-53d8dbb39cc3 req-7b63a1c6-a8f4-409a-a530-04da9ecf7970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0fef20f-3dfd-4d65-b5ed-50f3caaa011f", "tag": "e8b8b19d-91b5-4b5a-a71d-5c995462d419"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:11.410524 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-bc0daa15-ee75-415c-ae13-db37ce65e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.240680 Sep 03 01:34:11.411611 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 126/241] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:11 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:11.415904 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-bbf8a15b-acc1-4a70-a309-53d8dbb39cc3 req-7b63a1c6-a8f4-409a-a530-04da9ecf7970 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:11.416554 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-bbf8a15b-acc1-4a70-a309-53d8dbb39cc3 req-7b63a1c6-a8f4-409a-a530-04da9ecf7970 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:11.417646 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-bbf8a15b-acc1-4a70-a309-53d8dbb39cc3 req-7b63a1c6-a8f4-409a-a530-04da9ecf7970 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:11.430206 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-bbf8a15b-acc1-4a70-a309-53d8dbb39cc3 req-7b63a1c6-a8f4-409a-a530-04da9ecf7970 service nova] Creating event network-changed:e8b8b19d-91b5-4b5a-a71d-5c995462d419 for instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f on hv-cinder-83800 Sep 03 01:34:11.435467 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-bbf8a15b-acc1-4a70-a309-53d8dbb39cc3 req-7b63a1c6-a8f4-409a-a530-04da9ecf7970 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034303 Sep 03 01:34:11.436253 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 116/242] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:34:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:34:11.883823 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e7ccdc22-d3aa-470f-8ecb-86e8a911bb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:11.884588 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e7ccdc22-d3aa-470f-8ecb-86e8a911bb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:11.890551 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e7ccdc22-d3aa-470f-8ecb-86e8a911bb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:11.891032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e7ccdc22-d3aa-470f-8ecb-86e8a911bb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:11.891461 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e7ccdc22-d3aa-470f-8ecb-86e8a911bb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:11.892141 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e7ccdc22-d3aa-470f-8ecb-86e8a911bb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:11.892583 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e7ccdc22-d3aa-470f-8ecb-86e8a911bb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:11.893000 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e7ccdc22-d3aa-470f-8ecb-86e8a911bb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:12.027443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e7ccdc22-d3aa-470f-8ecb-86e8a911bb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:12.038075 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e7ccdc22-d3aa-470f-8ecb-86e8a911bb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:12.040785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e7ccdc22-d3aa-470f-8ecb-86e8a911bb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:12.042074 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e7ccdc22-d3aa-470f-8ecb-86e8a911bb8b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.162171 Sep 03 01:34:12.043002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 127/243] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:34:11 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:34:12.284365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-81ee215b-861e-4834-a367-5ed1a97a3271 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:12.285120 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-81ee215b-861e-4834-a367-5ed1a97a3271 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:12.292313 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81ee215b-861e-4834-a367-5ed1a97a3271 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:12.292796 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81ee215b-861e-4834-a367-5ed1a97a3271 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:12.293222 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81ee215b-861e-4834-a367-5ed1a97a3271 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:12.293908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81ee215b-861e-4834-a367-5ed1a97a3271 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:12.294408 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81ee215b-861e-4834-a367-5ed1a97a3271 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:12.295017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81ee215b-861e-4834-a367-5ed1a97a3271 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:12.428679 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-81ee215b-861e-4834-a367-5ed1a97a3271 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:12.433725 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5055534a-478d-4b49-b313-cde3b86d6301 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:12.434478 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5055534a-478d-4b49-b313-cde3b86d6301 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:12.436974 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-81ee215b-861e-4834-a367-5ed1a97a3271 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.157411 Sep 03 01:34:12.437576 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 117/244] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:12 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:12.441316 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5055534a-478d-4b49-b313-cde3b86d6301 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:12.441916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5055534a-478d-4b49-b313-cde3b86d6301 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:12.442445 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5055534a-478d-4b49-b313-cde3b86d6301 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:12.443348 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5055534a-478d-4b49-b313-cde3b86d6301 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:12.443876 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5055534a-478d-4b49-b313-cde3b86d6301 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:12.444456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5055534a-478d-4b49-b313-cde3b86d6301 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:12.592861 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5055534a-478d-4b49-b313-cde3b86d6301 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:12.600682 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5055534a-478d-4b49-b313-cde3b86d6301 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.170666 Sep 03 01:34:12.601346 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 128/245] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:12 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:13.067439 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5eafb08b-65b3-44e5-a532-8d08092055bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:13.068007 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5eafb08b-65b3-44e5-a532-8d08092055bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:13.074553 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5eafb08b-65b3-44e5-a532-8d08092055bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:13.075115 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5eafb08b-65b3-44e5-a532-8d08092055bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:13.075453 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5eafb08b-65b3-44e5-a532-8d08092055bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:13.076136 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5eafb08b-65b3-44e5-a532-8d08092055bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:13.076820 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5eafb08b-65b3-44e5-a532-8d08092055bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:13.077237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5eafb08b-65b3-44e5-a532-8d08092055bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:13.081370 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:13.212922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5eafb08b-65b3-44e5-a532-8d08092055bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:13.221176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5eafb08b-65b3-44e5-a532-8d08092055bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:13.222632 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5eafb08b-65b3-44e5-a532-8d08092055bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:13.223714 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5eafb08b-65b3-44e5-a532-8d08092055bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1407 microversion: 2.20 time: 0.160479 Sep 03 01:34:13.224263 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 118/246] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:34:13 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:34:13.459547 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2708057d-2633-4c8f-bf8a-fe494717c8b2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:13.460152 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2708057d-2633-4c8f-bf8a-fe494717c8b2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:13.465939 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2708057d-2633-4c8f-bf8a-fe494717c8b2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:13.466431 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2708057d-2633-4c8f-bf8a-fe494717c8b2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:13.466860 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2708057d-2633-4c8f-bf8a-fe494717c8b2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:13.467530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2708057d-2633-4c8f-bf8a-fe494717c8b2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:13.468004 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2708057d-2633-4c8f-bf8a-fe494717c8b2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:13.468423 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2708057d-2633-4c8f-bf8a-fe494717c8b2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:13.608475 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2708057d-2633-4c8f-bf8a-fe494717c8b2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:13.617532 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2708057d-2633-4c8f-bf8a-fe494717c8b2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.161698 Sep 03 01:34:13.622411 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 129/247] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:13 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:13.625596 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-be3ffd86-8c3f-4b2a-9806-03cafedea826 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:13.627053 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-be3ffd86-8c3f-4b2a-9806-03cafedea826 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:13.647727 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-be3ffd86-8c3f-4b2a-9806-03cafedea826 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:13.647727 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-be3ffd86-8c3f-4b2a-9806-03cafedea826 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:13.647727 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-be3ffd86-8c3f-4b2a-9806-03cafedea826 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:13.650513 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-be3ffd86-8c3f-4b2a-9806-03cafedea826 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:13.651560 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-be3ffd86-8c3f-4b2a-9806-03cafedea826 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:13.653522 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-be3ffd86-8c3f-4b2a-9806-03cafedea826 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:13.810510 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-be3ffd86-8c3f-4b2a-9806-03cafedea826 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:13.817137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-be3ffd86-8c3f-4b2a-9806-03cafedea826 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1367 microversion: 2.1 time: 0.195789 Sep 03 01:34:13.818316 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 119/248] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:13 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:14.249171 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-1620e7fd-5a32-4974-ab2b-8a979b49d121 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:14.249751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-1620e7fd-5a32-4974-ab2b-8a979b49d121 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:14.256707 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1620e7fd-5a32-4974-ab2b-8a979b49d121 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:14.257192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1620e7fd-5a32-4974-ab2b-8a979b49d121 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:14.257621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1620e7fd-5a32-4974-ab2b-8a979b49d121 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:14.258307 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1620e7fd-5a32-4974-ab2b-8a979b49d121 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:14.258774 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1620e7fd-5a32-4974-ab2b-8a979b49d121 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:14.259196 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1620e7fd-5a32-4974-ab2b-8a979b49d121 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:14.426846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1620e7fd-5a32-4974-ab2b-8a979b49d121 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:14.439815 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1620e7fd-5a32-4974-ab2b-8a979b49d121 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:14.441262 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1620e7fd-5a32-4974-ab2b-8a979b49d121 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:14.442455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-1620e7fd-5a32-4974-ab2b-8a979b49d121 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1600 microversion: 2.20 time: 0.197409 Sep 03 01:34:14.443009 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 130/249] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:34:14 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1600 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:34:14.468678 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-19a0d488-15e7-4eba-b010-fcac4c896707 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:14.469175 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-19a0d488-15e7-4eba-b010-fcac4c896707 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:14.475143 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-19a0d488-15e7-4eba-b010-fcac4c896707 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:14.475620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-19a0d488-15e7-4eba-b010-fcac4c896707 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:14.476058 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-19a0d488-15e7-4eba-b010-fcac4c896707 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:14.476746 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-19a0d488-15e7-4eba-b010-fcac4c896707 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:14.477195 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-19a0d488-15e7-4eba-b010-fcac4c896707 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:14.477617 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-19a0d488-15e7-4eba-b010-fcac4c896707 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:14.553761 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-19a0d488-15e7-4eba-b010-fcac4c896707 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.089061 Sep 03 01:34:14.554368 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 120/250] 10.222.0.13 () {60 vars in 1316 bytes} [Sat Sep 3 01:34:14 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:34:14.641087 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6ea4d357-1073-4919-ba44-39a6c2210bb0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:14.641834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6ea4d357-1073-4919-ba44-39a6c2210bb0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:14.648405 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6ea4d357-1073-4919-ba44-39a6c2210bb0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:14.648891 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6ea4d357-1073-4919-ba44-39a6c2210bb0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:14.649325 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6ea4d357-1073-4919-ba44-39a6c2210bb0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:14.650018 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6ea4d357-1073-4919-ba44-39a6c2210bb0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:14.650520 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6ea4d357-1073-4919-ba44-39a6c2210bb0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:14.650979 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6ea4d357-1073-4919-ba44-39a6c2210bb0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:14.785188 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6ea4d357-1073-4919-ba44-39a6c2210bb0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:14.795130 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6ea4d357-1073-4919-ba44-39a6c2210bb0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.157807 Sep 03 01:34:14.796405 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 131/251] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:14 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:14.914063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9f364c23-2e97-4dbd-9959-9f13bd2f6e08 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:14.914063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9f364c23-2e97-4dbd-9959-9f13bd2f6e08 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:14.914063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f364c23-2e97-4dbd-9959-9f13bd2f6e08 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:14.914063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f364c23-2e97-4dbd-9959-9f13bd2f6e08 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:14.914903 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f364c23-2e97-4dbd-9959-9f13bd2f6e08 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:14.914903 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f364c23-2e97-4dbd-9959-9f13bd2f6e08 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:14.914903 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f364c23-2e97-4dbd-9959-9f13bd2f6e08 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:14.914903 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f364c23-2e97-4dbd-9959-9f13bd2f6e08 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:15.345986 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9f364c23-2e97-4dbd-9959-9f13bd2f6e08 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:15.354538 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9f364c23-2e97-4dbd-9959-9f13bd2f6e08 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1556 microversion: 2.1 time: 0.517970 Sep 03 01:34:15.355117 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 121/252] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:14 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1556 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:15.378665 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-bf0663e5-31e7-4aaa-a11f-eb3c0ae3f16c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:15.382850 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-bf0663e5-31e7-4aaa-a11f-eb3c0ae3f16c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:15.386559 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bf0663e5-31e7-4aaa-a11f-eb3c0ae3f16c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:15.387236 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bf0663e5-31e7-4aaa-a11f-eb3c0ae3f16c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:15.387773 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bf0663e5-31e7-4aaa-a11f-eb3c0ae3f16c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:15.388708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bf0663e5-31e7-4aaa-a11f-eb3c0ae3f16c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:15.389312 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bf0663e5-31e7-4aaa-a11f-eb3c0ae3f16c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:15.390003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bf0663e5-31e7-4aaa-a11f-eb3c0ae3f16c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:15.555680 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-bf0663e5-31e7-4aaa-a11f-eb3c0ae3f16c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.180918 Sep 03 01:34:15.556533 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 132/253] 10.222.0.13 () {58 vars in 1275 bytes} [Sat Sep 3 01:34:15 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:34:15.822119 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ce8fb6d8-38e2-4253-9fff-1a8a1e988547 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:15.823870 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ce8fb6d8-38e2-4253-9fff-1a8a1e988547 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:15.834875 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ce8fb6d8-38e2-4253-9fff-1a8a1e988547 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:15.835657 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ce8fb6d8-38e2-4253-9fff-1a8a1e988547 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:15.836267 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ce8fb6d8-38e2-4253-9fff-1a8a1e988547 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:15.837155 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ce8fb6d8-38e2-4253-9fff-1a8a1e988547 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:15.837920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ce8fb6d8-38e2-4253-9fff-1a8a1e988547 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:15.838564 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ce8fb6d8-38e2-4253-9fff-1a8a1e988547 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:16.107303 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ce8fb6d8-38e2-4253-9fff-1a8a1e988547 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:16.118808 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ce8fb6d8-38e2-4253-9fff-1a8a1e988547 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.301295 Sep 03 01:34:16.132624 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 122/254] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:15 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:16.299641 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-a7943353-3221-47e3-a626-7a74b2b99d11 req-57ad87ea-adb3-47fb-aa4a-0db8585667c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "329ea656-c337-4f07-bd3d-9f67c4d6418e", "tag": "8e331545-f680-453c-942e-5cd9fc274b5f"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:16.309862 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a7943353-3221-47e3-a626-7a74b2b99d11 req-57ad87ea-adb3-47fb-aa4a-0db8585667c7 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:16.310360 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a7943353-3221-47e3-a626-7a74b2b99d11 req-57ad87ea-adb3-47fb-aa4a-0db8585667c7 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:16.310850 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a7943353-3221-47e3-a626-7a74b2b99d11 req-57ad87ea-adb3-47fb-aa4a-0db8585667c7 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:16.324057 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-a7943353-3221-47e3-a626-7a74b2b99d11 req-57ad87ea-adb3-47fb-aa4a-0db8585667c7 service nova] Creating event network-changed:8e331545-f680-453c-942e-5cd9fc274b5f for instance 329ea656-c337-4f07-bd3d-9f67c4d6418e on hv-cinder-83800 Sep 03 01:34:16.329169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-a7943353-3221-47e3-a626-7a74b2b99d11 req-57ad87ea-adb3-47fb-aa4a-0db8585667c7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033177 Sep 03 01:34:16.329770 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 133/255] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:34:17.152009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9a3955bb-165d-498d-847d-46f9b9ad8808 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:17.152009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9a3955bb-165d-498d-847d-46f9b9ad8808 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:17.154700 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a3955bb-165d-498d-847d-46f9b9ad8808 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:17.155402 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a3955bb-165d-498d-847d-46f9b9ad8808 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:17.156294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a3955bb-165d-498d-847d-46f9b9ad8808 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:17.157179 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a3955bb-165d-498d-847d-46f9b9ad8808 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:17.157807 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a3955bb-165d-498d-847d-46f9b9ad8808 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:17.158459 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a3955bb-165d-498d-847d-46f9b9ad8808 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:17.378664 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-30948878-b2d3-4671-baea-5d440ff5e6cd req-729bc317-9579-4937-9e10-76c204e9d9fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb", "tag": "fc3e436d-fb1a-441d-bc04-3d6a3d3a5bc4"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:17.386169 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9a3955bb-165d-498d-847d-46f9b9ad8808 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:17.395279 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9a3955bb-165d-498d-847d-46f9b9ad8808 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.254453 Sep 03 01:34:17.402116 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-30948878-b2d3-4671-baea-5d440ff5e6cd req-729bc317-9579-4937-9e10-76c204e9d9fb service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:17.402652 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-30948878-b2d3-4671-baea-5d440ff5e6cd req-729bc317-9579-4937-9e10-76c204e9d9fb service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:17.403082 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-30948878-b2d3-4671-baea-5d440ff5e6cd req-729bc317-9579-4937-9e10-76c204e9d9fb service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:17.411102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 123/256] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:17 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:17.416353 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-30948878-b2d3-4671-baea-5d440ff5e6cd req-729bc317-9579-4937-9e10-76c204e9d9fb service nova] Creating event network-changed:fc3e436d-fb1a-441d-bc04-3d6a3d3a5bc4 for instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb on hv-cinder-83800 Sep 03 01:34:17.425352 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-30948878-b2d3-4671-baea-5d440ff5e6cd req-729bc317-9579-4937-9e10-76c204e9d9fb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053612 Sep 03 01:34:17.426152 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 134/257] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:34:18.423370 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-44af650f-0c38-4c88-9e00-767394445a3b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:18.423370 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-44af650f-0c38-4c88-9e00-767394445a3b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:18.443591 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-44af650f-0c38-4c88-9e00-767394445a3b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:18.447907 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-44af650f-0c38-4c88-9e00-767394445a3b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:18.451177 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-44af650f-0c38-4c88-9e00-767394445a3b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:18.451177 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-44af650f-0c38-4c88-9e00-767394445a3b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:18.451177 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-44af650f-0c38-4c88-9e00-767394445a3b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:18.451177 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-44af650f-0c38-4c88-9e00-767394445a3b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:18.661431 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-44af650f-0c38-4c88-9e00-767394445a3b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:18.670862 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-44af650f-0c38-4c88-9e00-767394445a3b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.254700 Sep 03 01:34:18.686875 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 124/258] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:18 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:19.695564 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-005af9e4-170f-49d8-87f0-392f7c34a346 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:19.697147 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-005af9e4-170f-49d8-87f0-392f7c34a346 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:19.704455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-005af9e4-170f-49d8-87f0-392f7c34a346 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:19.717177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-005af9e4-170f-49d8-87f0-392f7c34a346 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:19.718033 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-005af9e4-170f-49d8-87f0-392f7c34a346 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:19.718997 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-005af9e4-170f-49d8-87f0-392f7c34a346 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:19.719472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-005af9e4-170f-49d8-87f0-392f7c34a346 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:19.719907 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-005af9e4-170f-49d8-87f0-392f7c34a346 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:19.861374 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-005af9e4-170f-49d8-87f0-392f7c34a346 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:19.870789 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-005af9e4-170f-49d8-87f0-392f7c34a346 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.179554 Sep 03 01:34:19.872086 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 135/259] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:19 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:20.895018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-aa74f208-53cb-498d-9747-bdde34dfdc98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:20.895930 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-aa74f208-53cb-498d-9747-bdde34dfdc98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:20.903197 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa74f208-53cb-498d-9747-bdde34dfdc98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:20.903671 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa74f208-53cb-498d-9747-bdde34dfdc98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:20.904103 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa74f208-53cb-498d-9747-bdde34dfdc98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:20.904788 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa74f208-53cb-498d-9747-bdde34dfdc98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:20.905234 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa74f208-53cb-498d-9747-bdde34dfdc98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:20.906139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa74f208-53cb-498d-9747-bdde34dfdc98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:21.061301 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-aa74f208-53cb-498d-9747-bdde34dfdc98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:21.070411 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-aa74f208-53cb-498d-9747-bdde34dfdc98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.179635 Sep 03 01:34:21.078041 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 125/260] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:20 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:22.094050 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f97acf78-502d-498b-915f-19b62bdaf76c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:22.095035 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f97acf78-502d-498b-915f-19b62bdaf76c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:22.102890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f97acf78-502d-498b-915f-19b62bdaf76c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:22.104240 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f97acf78-502d-498b-915f-19b62bdaf76c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:22.104988 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f97acf78-502d-498b-915f-19b62bdaf76c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:22.105703 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f97acf78-502d-498b-915f-19b62bdaf76c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:22.106161 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f97acf78-502d-498b-915f-19b62bdaf76c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:22.106613 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f97acf78-502d-498b-915f-19b62bdaf76c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:22.253903 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f97acf78-502d-498b-915f-19b62bdaf76c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:22.262362 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f97acf78-502d-498b-915f-19b62bdaf76c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.172155 Sep 03 01:34:22.262960 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 136/261] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:22 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:23.285926 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f61399f3-6b6a-4fc2-92a5-fdfb56b08ff4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:23.287678 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f61399f3-6b6a-4fc2-92a5-fdfb56b08ff4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:23.290555 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=85 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:23.296209 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f61399f3-6b6a-4fc2-92a5-fdfb56b08ff4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:23.296828 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f61399f3-6b6a-4fc2-92a5-fdfb56b08ff4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:23.297502 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f61399f3-6b6a-4fc2-92a5-fdfb56b08ff4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:23.298367 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f61399f3-6b6a-4fc2-92a5-fdfb56b08ff4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:23.298967 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f61399f3-6b6a-4fc2-92a5-fdfb56b08ff4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:23.299583 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f61399f3-6b6a-4fc2-92a5-fdfb56b08ff4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:23.640934 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-f61399f3-6b6a-4fc2-92a5-fdfb56b08ff4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:23.649152 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f61399f3-6b6a-4fc2-92a5-fdfb56b08ff4 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.367644 Sep 03 01:34:23.649723 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 126/262] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:23 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:24.680698 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a619da34-c59d-4de0-a7c9-a02f410e6207 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:24.682840 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a619da34-c59d-4de0-a7c9-a02f410e6207 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:24.715981 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a619da34-c59d-4de0-a7c9-a02f410e6207 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:24.716737 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a619da34-c59d-4de0-a7c9-a02f410e6207 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:24.717189 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a619da34-c59d-4de0-a7c9-a02f410e6207 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:24.717903 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a619da34-c59d-4de0-a7c9-a02f410e6207 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:24.718528 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a619da34-c59d-4de0-a7c9-a02f410e6207 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:24.718951 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a619da34-c59d-4de0-a7c9-a02f410e6207 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:24.788507 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-02fc3d26-faf8-4063-8d35-b13e1d7893b2 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:24.790817 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-02fc3d26-faf8-4063-8d35-b13e1d7893b2 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:24.796095 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-02fc3d26-faf8-4063-8d35-b13e1d7893b2 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:24.796582 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-02fc3d26-faf8-4063-8d35-b13e1d7893b2 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:24.797013 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-02fc3d26-faf8-4063-8d35-b13e1d7893b2 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:24.797701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-02fc3d26-faf8-4063-8d35-b13e1d7893b2 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:24.798316 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-02fc3d26-faf8-4063-8d35-b13e1d7893b2 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:24.798956 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-02fc3d26-faf8-4063-8d35-b13e1d7893b2 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:24.828839 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-02fc3d26-faf8-4063-8d35-b13e1d7893b2 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:34:24.949641 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a619da34-c59d-4de0-a7c9-a02f410e6207 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:24.960038 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a619da34-c59d-4de0-a7c9-a02f410e6207 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.284371 Sep 03 01:34:24.960982 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 137/263] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:24 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:25.207884 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-02fc3d26-faf8-4063-8d35-b13e1d7893b2 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 204 len: 0 microversion: 2.1 time: 0.423548 Sep 03 01:34:25.209318 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 127/264] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:34:24 2022] DELETE /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 01:34:25.218094 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b2466592-c691-4eff-a8a1-002d48a55a11 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:25.219215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b2466592-c691-4eff-a8a1-002d48a55a11 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:25.227441 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2466592-c691-4eff-a8a1-002d48a55a11 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:25.228005 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2466592-c691-4eff-a8a1-002d48a55a11 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:25.228499 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2466592-c691-4eff-a8a1-002d48a55a11 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:25.229249 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2466592-c691-4eff-a8a1-002d48a55a11 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:25.229764 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2466592-c691-4eff-a8a1-002d48a55a11 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:25.230359 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2466592-c691-4eff-a8a1-002d48a55a11 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:25.407058 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b2466592-c691-4eff-a8a1-002d48a55a11 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:25.415687 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b2466592-c691-4eff-a8a1-002d48a55a11 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1553 microversion: 2.1 time: 0.201946 Sep 03 01:34:25.416255 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 138/265] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:25 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1553 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:25.984549 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d8fa8262-0781-40a9-a250-bb565f1018e1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:25.985285 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d8fa8262-0781-40a9-a250-bb565f1018e1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:25.992683 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d8fa8262-0781-40a9-a250-bb565f1018e1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:25.993216 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d8fa8262-0781-40a9-a250-bb565f1018e1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:25.993691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d8fa8262-0781-40a9-a250-bb565f1018e1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:25.994417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d8fa8262-0781-40a9-a250-bb565f1018e1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:25.996479 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d8fa8262-0781-40a9-a250-bb565f1018e1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:25.996479 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d8fa8262-0781-40a9-a250-bb565f1018e1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:26.281143 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d8fa8262-0781-40a9-a250-bb565f1018e1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:26.299119 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d8fa8262-0781-40a9-a250-bb565f1018e1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.318971 Sep 03 01:34:26.301791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 128/266] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:25 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:26.438859 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2e8493c9-1d0f-40e8-9045-066db7f2a0ec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:26.439501 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2e8493c9-1d0f-40e8-9045-066db7f2a0ec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:26.446393 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2e8493c9-1d0f-40e8-9045-066db7f2a0ec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:26.446888 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2e8493c9-1d0f-40e8-9045-066db7f2a0ec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:26.447322 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2e8493c9-1d0f-40e8-9045-066db7f2a0ec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:26.448015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2e8493c9-1d0f-40e8-9045-066db7f2a0ec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:26.448469 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2e8493c9-1d0f-40e8-9045-066db7f2a0ec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:26.448900 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2e8493c9-1d0f-40e8-9045-066db7f2a0ec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:26.616068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2e8493c9-1d0f-40e8-9045-066db7f2a0ec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:26.624961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2e8493c9-1d0f-40e8-9045-066db7f2a0ec tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1553 microversion: 2.1 time: 0.189922 Sep 03 01:34:26.625697 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 139/267] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:26 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1553 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:27.326488 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-07f127f3-d152-4c5e-86ae-3af813d82393 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:27.327725 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-07f127f3-d152-4c5e-86ae-3af813d82393 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:27.335573 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07f127f3-d152-4c5e-86ae-3af813d82393 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:27.336664 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07f127f3-d152-4c5e-86ae-3af813d82393 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:27.337198 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07f127f3-d152-4c5e-86ae-3af813d82393 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:27.338137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07f127f3-d152-4c5e-86ae-3af813d82393 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:27.338820 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07f127f3-d152-4c5e-86ae-3af813d82393 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:27.339447 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07f127f3-d152-4c5e-86ae-3af813d82393 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:27.500949 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-07f127f3-d152-4c5e-86ae-3af813d82393 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:27.505122 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-07f127f3-d152-4c5e-86ae-3af813d82393 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.183989 Sep 03 01:34:27.505745 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 129/268] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:27 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:27.649311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-961b7995-4243-4389-b321-39eb1d9a231d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:27.649870 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-961b7995-4243-4389-b321-39eb1d9a231d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:27.656249 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-961b7995-4243-4389-b321-39eb1d9a231d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:27.656733 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-961b7995-4243-4389-b321-39eb1d9a231d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:27.657167 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-961b7995-4243-4389-b321-39eb1d9a231d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:27.657859 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-961b7995-4243-4389-b321-39eb1d9a231d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:27.658312 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-961b7995-4243-4389-b321-39eb1d9a231d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:27.658759 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-961b7995-4243-4389-b321-39eb1d9a231d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:27.681397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:27.913668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-961b7995-4243-4389-b321-39eb1d9a231d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:27.924780 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-961b7995-4243-4389-b321-39eb1d9a231d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1553 microversion: 2.1 time: 0.279501 Sep 03 01:34:27.925572 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 140/269] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:27 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1553 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:28.199182 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-56740511-3ecf-420c-8927-6b3f6fd61fc8 req-728d27c3-2934-49e3-b51c-4b9838534d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05cc922e-348e-42a7-a4ff-6b8ba6c91fad", "name": "network-vif-deleted", "tag": "4b292e8b-d77c-4f44-9888-e42a1b3cbaef"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:28.216105 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-56740511-3ecf-420c-8927-6b3f6fd61fc8 req-728d27c3-2934-49e3-b51c-4b9838534d9d service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:28.217221 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-56740511-3ecf-420c-8927-6b3f6fd61fc8 req-728d27c3-2934-49e3-b51c-4b9838534d9d service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:28.217920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-56740511-3ecf-420c-8927-6b3f6fd61fc8 req-728d27c3-2934-49e3-b51c-4b9838534d9d service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:28.234551 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-56740511-3ecf-420c-8927-6b3f6fd61fc8 req-728d27c3-2934-49e3-b51c-4b9838534d9d service nova] Creating event network-vif-deleted:4b292e8b-d77c-4f44-9888-e42a1b3cbaef for instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad on hv-cinder-83800 Sep 03 01:34:28.244168 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-56740511-3ecf-420c-8927-6b3f6fd61fc8 req-728d27c3-2934-49e3-b51c-4b9838534d9d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050446 Sep 03 01:34:28.245373 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 130/270] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:34:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:34:28.528094 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-bc43670e-7874-421e-92c2-deb389cc8c2f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:28.528798 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-bc43670e-7874-421e-92c2-deb389cc8c2f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:28.535098 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bc43670e-7874-421e-92c2-deb389cc8c2f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:28.535655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bc43670e-7874-421e-92c2-deb389cc8c2f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:28.536270 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bc43670e-7874-421e-92c2-deb389cc8c2f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:28.537130 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bc43670e-7874-421e-92c2-deb389cc8c2f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:28.537708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bc43670e-7874-421e-92c2-deb389cc8c2f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:28.538226 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bc43670e-7874-421e-92c2-deb389cc8c2f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:28.698668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bc43670e-7874-421e-92c2-deb389cc8c2f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:28.706262 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-bc43670e-7874-421e-92c2-deb389cc8c2f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.182050 Sep 03 01:34:28.706871 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 141/271] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:28 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:28.952229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:28.952835 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:28.959065 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:28.959546 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:28.965215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:28.965215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:28.965215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:28.965215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:28.997168 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:28.997705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:28.998113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:28.998562 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lazy-loading 'fault' on Instance uuid 05cc922e-348e-42a7-a4ff-6b8ba6c91fad {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:34:29.050930 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:29.060184 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-992c0415-8da7-4690-a631-ad021c72f24d tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1350 microversion: 2.1 time: 0.112735 Sep 03 01:34:29.060764 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 131/272] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:28 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:29.729043 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d23f7789-af24-4282-b6ec-d763246b4e52 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:29.729586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d23f7789-af24-4282-b6ec-d763246b4e52 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:29.735370 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d23f7789-af24-4282-b6ec-d763246b4e52 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:29.735903 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d23f7789-af24-4282-b6ec-d763246b4e52 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:29.736338 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d23f7789-af24-4282-b6ec-d763246b4e52 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:29.737019 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d23f7789-af24-4282-b6ec-d763246b4e52 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:29.737469 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d23f7789-af24-4282-b6ec-d763246b4e52 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:29.737892 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d23f7789-af24-4282-b6ec-d763246b4e52 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:29.873787 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d23f7789-af24-4282-b6ec-d763246b4e52 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:29.882262 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d23f7789-af24-4282-b6ec-d763246b4e52 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.157094 Sep 03 01:34:29.882865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 142/273] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:29 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:30.092011 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:30.093288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:30.101394 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:30.101894 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:30.102362 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:30.103107 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:30.103557 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:30.103979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:30.143760 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:30.144284 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:30.144712 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:30.145156 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lazy-loading 'fault' on Instance uuid 05cc922e-348e-42a7-a4ff-6b8ba6c91fad {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:34:30.188561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd73c9c5108a845fdbd25b67bcb3a00f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0a44ea5393c4fb58fce35e8cbc4103b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:30.196306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-37ee62a4-56ab-4987-8fcb-3db453b4e486 tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 200 len: 1304 microversion: 2.1 time: 0.111814 Sep 03 01:34:30.196870 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 132/274] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:30 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:30.915253 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a2202756-e829-4860-8882-0d16aad0c3ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:30.915985 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a2202756-e829-4860-8882-0d16aad0c3ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:30.931722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a2202756-e829-4860-8882-0d16aad0c3ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:30.943689 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a2202756-e829-4860-8882-0d16aad0c3ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:30.944486 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a2202756-e829-4860-8882-0d16aad0c3ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:30.945313 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a2202756-e829-4860-8882-0d16aad0c3ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:30.945775 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a2202756-e829-4860-8882-0d16aad0c3ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:30.946213 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a2202756-e829-4860-8882-0d16aad0c3ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:31.073283 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a2202756-e829-4860-8882-0d16aad0c3ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:31.082199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a2202756-e829-4860-8882-0d16aad0c3ab tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.173514 Sep 03 01:34:31.084519 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 143/275] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:30 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:31.219140 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d4b5cc8c-4eac-40ca-9ce8-6f3c73adb61c tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:31.219837 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d4b5cc8c-4eac-40ca-9ce8-6f3c73adb61c tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:31.227084 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4b5cc8c-4eac-40ca-9ce8-6f3c73adb61c tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:31.227560 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4b5cc8c-4eac-40ca-9ce8-6f3c73adb61c tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:31.227989 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4b5cc8c-4eac-40ca-9ce8-6f3c73adb61c tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:31.228690 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4b5cc8c-4eac-40ca-9ce8-6f3c73adb61c tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:31.229457 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4b5cc8c-4eac-40ca-9ce8-6f3c73adb61c tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:31.229573 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4b5cc8c-4eac-40ca-9ce8-6f3c73adb61c tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:31.243063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-d4b5cc8c-4eac-40ca-9ce8-6f3c73adb61c tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] HTTP exception thrown: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d4b5cc8c-4eac-40ca-9ce8-6f3c73adb61c tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Request method failure captured: Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad HTTP/1.1 Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7Q_zJCpwiaSsinQNgQ4dvQRY1sz1vAYiUGmR2gknxyeL95QV6SeFd4HGTXi_2rv2bqBpOzTdUza26rKoybkPJgqh-0LYULItZWgsN-AIjjm4hrUqlcuEfmET-WFbaVIyon6eU5vakW_3azCVDBeF9zd57XPsCJNzuXSaesezTe0Bo Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: c0a44ea5393c4fb58fce35e8cbc4103b Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-DeleteServersTestJSON-541869788 Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:34:31.247644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:34:31.249137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:34:31.249137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-DeleteServersTestJSON-541869788 Sep 03 01:34:31.249137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: c0a44ea5393c4fb58fce35e8cbc4103b Sep 03 01:34:31.249137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-DeleteServersTestJSON-541869788 Sep 03 01:34:31.249137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-DeleteServersTestJSON-541869788-project Sep 03 01:34:31.249137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:34:31.249137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:34:31.249137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: d73c9c5108a845fdbd25b67bcb3a00f4 Sep 03 01:34:31.249137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-DeleteServersTestJSON-541869788-project Sep 03 01:34:31.249137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:34:31.249137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:31.249137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '05cc922e-348e-42a7-a4ff-6b8ba6c91fad'} Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:34:31.249927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:31.251188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:31.252193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d4b5cc8c-4eac-40ca-9ce8-6f3c73adb61c tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Returning 404 to user: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:34:31.252193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d4b5cc8c-4eac-40ca-9ce8-6f3c73adb61c tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 404 len: 111 microversion: 2.1 time: 0.033835 Sep 03 01:34:31.252193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 133/276] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:31 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 01:34:31.394409 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0f9f8cd7-496b-4504-a72b-43e17bf24c7f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:31.397994 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0f9f8cd7-496b-4504-a72b-43e17bf24c7f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:31.406104 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f9f8cd7-496b-4504-a72b-43e17bf24c7f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:31.406621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f9f8cd7-496b-4504-a72b-43e17bf24c7f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:31.407114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f9f8cd7-496b-4504-a72b-43e17bf24c7f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:31.408090 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f9f8cd7-496b-4504-a72b-43e17bf24c7f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:31.408423 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f9f8cd7-496b-4504-a72b-43e17bf24c7f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:31.408854 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f9f8cd7-496b-4504-a72b-43e17bf24c7f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:31.422813 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-0f9f8cd7-496b-4504-a72b-43e17bf24c7f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] HTTP exception thrown: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0f9f8cd7-496b-4504-a72b-43e17bf24c7f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Request method failure captured: Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad/os-volume_attachments HTTP/1.1 Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7Q_zJCpwiaSsinQNgQ4dvQRY1sz1vAYiUGmR2gknxyeL95QV6SeFd4HGTXi_2rv2bqBpOzTdUza26rKoybkPJgqh-0LYULItZWgsN-AIjjm4hrUqlcuEfmET-WFbaVIyon6eU5vakW_3azCVDBeF9zd57XPsCJNzuXSaesezTe0Bo Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: c0a44ea5393c4fb58fce35e8cbc4103b Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-DeleteServersTestJSON-541869788 Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:34:31.439497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:34:31.444722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:34:31.444722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-DeleteServersTestJSON-541869788 Sep 03 01:34:31.444722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: c0a44ea5393c4fb58fce35e8cbc4103b Sep 03 01:34:31.444722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-DeleteServersTestJSON-541869788 Sep 03 01:34:31.444722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-DeleteServersTestJSON-541869788-project Sep 03 01:34:31.444722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:34:31.444722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:34:31.444722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: d73c9c5108a845fdbd25b67bcb3a00f4 Sep 03 01:34:31.444722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-DeleteServersTestJSON-541869788-project Sep 03 01:34:31.444722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:34:31.444722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:31.444722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'server_id': '05cc922e-348e-42a7-a4ff-6b8ba6c91fad'} Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:34:31.445541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:31.446661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:31.447733 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0f9f8cd7-496b-4504-a72b-43e17bf24c7f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Returning 404 to user: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:34:31.447733 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0f9f8cd7-496b-4504-a72b-43e17bf24c7f tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.052626 Sep 03 01:34:31.447733 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 144/277] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:34:31 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad/os-volume_attachments => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:34:31.450488 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-47258587", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "networks": [{"uuid": "64961fe8-d6d6-4f3f-97ee-ec37229fbea7"}]}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:31.531795 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.network.neutron [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] validate_networks() for [('64961fe8-d6d6-4f3f-97ee-ec37229fbea7', None, None, None, None, None)] {{(pid=127553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:34:31.980250 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Flavor limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:34:31.981078 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Image limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:34:31.981217 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Flavor pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:34:31.981514 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Image pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:34:31.981932 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:34:32.000150 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:32.004120 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:32.004120 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:32.004120 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:32.004120 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:32.004484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:32.013144 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:32.026967 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Getting quotas for project efd244ba290249568e3a6f8bd3e7e814. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:34:32.032643 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Getting quotas for user 205b8f60af7a4957a578f21f9ea464dd and project efd244ba290249568e3a6f8bd3e7e814. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:34:32.044584 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Going to run 1 instances... {{(pid=127553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:34:32.046908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:34:32.107789 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-45c28c16-7545-459e-a54f-da889053b366 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:32.109510 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-45c28c16-7545-459e-a54f-da889053b366 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:32.117850 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-45c28c16-7545-459e-a54f-da889053b366 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:32.118869 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-45c28c16-7545-459e-a54f-da889053b366 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:32.119703 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-45c28c16-7545-459e-a54f-da889053b366 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:32.120752 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-45c28c16-7545-459e-a54f-da889053b366 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:32.121419 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-45c28c16-7545-459e-a54f-da889053b366 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:32.122074 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-45c28c16-7545-459e-a54f-da889053b366 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:32.215357 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-37fcb14c-179d-49a6-83ff-7d81e57435e7 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768892 Sep 03 01:34:32.216416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 134/278] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:34:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:34:32.230601 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-871f3f30-1c55-4d5c-8d4e-c9cf7d61ebca tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:32.231308 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-871f3f30-1c55-4d5c-8d4e-c9cf7d61ebca tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:32.314582 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-45c28c16-7545-459e-a54f-da889053b366 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:32.328329 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-871f3f30-1c55-4d5c-8d4e-c9cf7d61ebca tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:32.330261 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-45c28c16-7545-459e-a54f-da889053b366 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.227045 Sep 03 01:34:32.330872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 145/279] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:32 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:32.338948 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-871f3f30-1c55-4d5c-8d4e-c9cf7d61ebca tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1212 microversion: 2.1 time: 0.113549 Sep 03 01:34:32.351028 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 135/280] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:32 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1212 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:32.835530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-664fc3a4-153a-4ba9-b61c-63ce852d3c8b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:32.836056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-664fc3a4-153a-4ba9-b61c-63ce852d3c8b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:32.841884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-664fc3a4-153a-4ba9-b61c-63ce852d3c8b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:32.842439 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-664fc3a4-153a-4ba9-b61c-63ce852d3c8b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:32.842892 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-664fc3a4-153a-4ba9-b61c-63ce852d3c8b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:32.843551 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-664fc3a4-153a-4ba9-b61c-63ce852d3c8b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:32.843995 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-664fc3a4-153a-4ba9-b61c-63ce852d3c8b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:32.844413 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-664fc3a4-153a-4ba9-b61c-63ce852d3c8b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:32.858938 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-664fc3a4-153a-4ba9-b61c-63ce852d3c8b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] HTTP exception thrown: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-664fc3a4-153a-4ba9-b61c-63ce852d3c8b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Request method failure captured: Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: DELETE /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad HTTP/1.1 Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7Q_zJCpwiaSsinQNgQ4dvQRY1sz1vAYiUGmR2gknxyeL95QV6SeFd4HGTXi_2rv2bqBpOzTdUza26rKoybkPJgqh-0LYULItZWgsN-AIjjm4hrUqlcuEfmET-WFbaVIyon6eU5vakW_3azCVDBeF9zd57XPsCJNzuXSaesezTe0Bo Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: c0a44ea5393c4fb58fce35e8cbc4103b Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-DeleteServersTestJSON-541869788 Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:34:32.861169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:34:32.862443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:34:32.862443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-DeleteServersTestJSON-541869788 Sep 03 01:34:32.862443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: c0a44ea5393c4fb58fce35e8cbc4103b Sep 03 01:34:32.862443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-DeleteServersTestJSON-541869788 Sep 03 01:34:32.862443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-DeleteServersTestJSON-541869788-project Sep 03 01:34:32.862443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:34:32.862443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:34:32.862443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: d73c9c5108a845fdbd25b67bcb3a00f4 Sep 03 01:34:32.862443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-DeleteServersTestJSON-541869788-project Sep 03 01:34:32.862443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:34:32.862443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:32.862443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '05cc922e-348e-42a7-a4ff-6b8ba6c91fad'} Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:34:32.863163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:32.870107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:32.871267 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-664fc3a4-153a-4ba9-b61c-63ce852d3c8b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Returning 404 to user: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:34:32.871267 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-664fc3a4-153a-4ba9-b61c-63ce852d3c8b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 404 len: 111 microversion: 2.1 time: 0.031098 Sep 03 01:34:32.871267 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 146/281] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:34:32 2022] DELETE /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:34:32.877418 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-89f3cbf8-9464-4023-b5b4-30d60e30704b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:32.878032 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-89f3cbf8-9464-4023-b5b4-30d60e30704b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] [instance: 05cc922e-348e-42a7-a4ff-6b8ba6c91fad] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:32.885049 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-89f3cbf8-9464-4023-b5b4-30d60e30704b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:32.885539 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-89f3cbf8-9464-4023-b5b4-30d60e30704b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:32.885972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-89f3cbf8-9464-4023-b5b4-30d60e30704b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:32.889960 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-89f3cbf8-9464-4023-b5b4-30d60e30704b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:32.889960 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-89f3cbf8-9464-4023-b5b4-30d60e30704b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:32.889960 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-89f3cbf8-9464-4023-b5b4-30d60e30704b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:32.905058 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-89f3cbf8-9464-4023-b5b4-30d60e30704b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] HTTP exception thrown: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-89f3cbf8-9464-4023-b5b4-30d60e30704b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Request method failure captured: Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad HTTP/1.1 Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7Q_zJCpwiaSsinQNgQ4dvQRY1sz1vAYiUGmR2gknxyeL95QV6SeFd4HGTXi_2rv2bqBpOzTdUza26rKoybkPJgqh-0LYULItZWgsN-AIjjm4hrUqlcuEfmET-WFbaVIyon6eU5vakW_3azCVDBeF9zd57XPsCJNzuXSaesezTe0Bo Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: c0a44ea5393c4fb58fce35e8cbc4103b Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-DeleteServersTestJSON-541869788 Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:34:32.906885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:34:32.908141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c0a44ea5393c4fb58fce35e8cbc4103b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:34:32.908141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-DeleteServersTestJSON-541869788 Sep 03 01:34:32.908141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: c0a44ea5393c4fb58fce35e8cbc4103b Sep 03 01:34:32.908141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-DeleteServersTestJSON-541869788 Sep 03 01:34:32.908141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-DeleteServersTestJSON-541869788-project Sep 03 01:34:32.908141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:34:32.908141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:34:32.908141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: d73c9c5108a845fdbd25b67bcb3a00f4 Sep 03 01:34:32.908141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-DeleteServersTestJSON-541869788-project Sep 03 01:34:32.908141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:34:32.908141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:32.908141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '05cc922e-348e-42a7-a4ff-6b8ba6c91fad'} Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:34:32.908800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. Sep 03 01:34:32.910167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:32.911504 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-89f3cbf8-9464-4023-b5b4-30d60e30704b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] Returning 404 to user: Instance 05cc922e-348e-42a7-a4ff-6b8ba6c91fad could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:34:32.911504 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-89f3cbf8-9464-4023-b5b4-30d60e30704b tempest-DeleteServersTestJSON-541869788 tempest-DeleteServersTestJSON-541869788-project] 10.222.0.13 "GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad" status: 404 len: 111 microversion: 2.1 time: 0.034852 Sep 03 01:34:32.911504 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 136/282] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:32 2022] GET /compute/v2.1/servers/05cc922e-348e-42a7-a4ff-6b8ba6c91fad => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:34:33.356201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ff4a6332-04bc-4139-add6-e00b6c5c9901 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:33.357800 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ff4a6332-04bc-4139-add6-e00b6c5c9901 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:33.368873 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ff4a6332-04bc-4139-add6-e00b6c5c9901 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:33.369466 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ff4a6332-04bc-4139-add6-e00b6c5c9901 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:33.369898 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e118d286-3e82-4e87-9bc3-8883bca11cfb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:33.370323 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ff4a6332-04bc-4139-add6-e00b6c5c9901 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:33.370649 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ff4a6332-04bc-4139-add6-e00b6c5c9901 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:33.371103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ff4a6332-04bc-4139-add6-e00b6c5c9901 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:33.371287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e118d286-3e82-4e87-9bc3-8883bca11cfb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:33.372052 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ff4a6332-04bc-4139-add6-e00b6c5c9901 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:33.381946 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e118d286-3e82-4e87-9bc3-8883bca11cfb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:33.386245 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e118d286-3e82-4e87-9bc3-8883bca11cfb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:33.386784 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e118d286-3e82-4e87-9bc3-8883bca11cfb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:33.387990 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e118d286-3e82-4e87-9bc3-8883bca11cfb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:33.389880 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e118d286-3e82-4e87-9bc3-8883bca11cfb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:33.390455 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e118d286-3e82-4e87-9bc3-8883bca11cfb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:33.477016 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e118d286-3e82-4e87-9bc3-8883bca11cfb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:33.486832 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e118d286-3e82-4e87-9bc3-8883bca11cfb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1216 microversion: 2.1 time: 0.127448 Sep 03 01:34:33.487631 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 137/283] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:33 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1216 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:33.555807 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ff4a6332-04bc-4139-add6-e00b6c5c9901 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:33.563571 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ff4a6332-04bc-4139-add6-e00b6c5c9901 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1521 microversion: 2.1 time: 0.211399 Sep 03 01:34:33.564127 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 147/284] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:33 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:34.510722 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-24e49cdb-27e8-4cc7-b416-fc4b0bde1030 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:34.512208 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-24e49cdb-27e8-4cc7-b416-fc4b0bde1030 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:34.519354 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-24e49cdb-27e8-4cc7-b416-fc4b0bde1030 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:34.520035 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-24e49cdb-27e8-4cc7-b416-fc4b0bde1030 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:34.520669 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-24e49cdb-27e8-4cc7-b416-fc4b0bde1030 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:34.521542 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-24e49cdb-27e8-4cc7-b416-fc4b0bde1030 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:34.522562 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-24e49cdb-27e8-4cc7-b416-fc4b0bde1030 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:34.523401 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-24e49cdb-27e8-4cc7-b416-fc4b0bde1030 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:34.587540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e027a4be-863f-453b-993d-51e6f102a92f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:34.588319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e027a4be-863f-453b-993d-51e6f102a92f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:34.596627 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e027a4be-863f-453b-993d-51e6f102a92f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:34.597125 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e027a4be-863f-453b-993d-51e6f102a92f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:34.597587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e027a4be-863f-453b-993d-51e6f102a92f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:34.598436 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e027a4be-863f-453b-993d-51e6f102a92f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:34.598899 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e027a4be-863f-453b-993d-51e6f102a92f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:34.599393 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e027a4be-863f-453b-993d-51e6f102a92f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:34.615726 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-24e49cdb-27e8-4cc7-b416-fc4b0bde1030 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:34.624476 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-24e49cdb-27e8-4cc7-b416-fc4b0bde1030 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1264 microversion: 2.1 time: 0.117504 Sep 03 01:34:34.629734 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 138/285] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:34 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1264 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:34.759205 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e027a4be-863f-453b-993d-51e6f102a92f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:34.767526 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e027a4be-863f-453b-993d-51e6f102a92f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1501 microversion: 2.1 time: 0.184722 Sep 03 01:34:34.768176 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 148/286] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:34 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1501 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:34.792963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bd3af5be-8bfb-4a85-8acf-dca1113f8fba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:34.793945 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bd3af5be-8bfb-4a85-8acf-dca1113f8fba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:34.801881 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd3af5be-8bfb-4a85-8acf-dca1113f8fba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:34.808770 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd3af5be-8bfb-4a85-8acf-dca1113f8fba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:34.808770 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd3af5be-8bfb-4a85-8acf-dca1113f8fba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:34.808770 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd3af5be-8bfb-4a85-8acf-dca1113f8fba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:34.808770 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd3af5be-8bfb-4a85-8acf-dca1113f8fba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:34.810184 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd3af5be-8bfb-4a85-8acf-dca1113f8fba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:35.048371 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bd3af5be-8bfb-4a85-8acf-dca1113f8fba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:35.061190 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bd3af5be-8bfb-4a85-8acf-dca1113f8fba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1515 microversion: 2.1 time: 0.274561 Sep 03 01:34:35.064582 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 139/287] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:34 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1515 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:35.648160 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0264a48d-af6f-49ce-9fa0-979f888933b4 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:35.649503 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0264a48d-af6f-49ce-9fa0-979f888933b4 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:35.658793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0264a48d-af6f-49ce-9fa0-979f888933b4 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:35.659883 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0264a48d-af6f-49ce-9fa0-979f888933b4 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:35.660496 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0264a48d-af6f-49ce-9fa0-979f888933b4 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:35.661760 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0264a48d-af6f-49ce-9fa0-979f888933b4 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:35.663457 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0264a48d-af6f-49ce-9fa0-979f888933b4 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:35.664053 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0264a48d-af6f-49ce-9fa0-979f888933b4 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:35.870994 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0264a48d-af6f-49ce-9fa0-979f888933b4 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:35.884019 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0264a48d-af6f-49ce-9fa0-979f888933b4 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1270 microversion: 2.1 time: 0.240257 Sep 03 01:34:35.885235 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 149/288] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:35 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1270 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:36.917043 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-74019b56-7ed6-42c2-bde5-fcaa2105def5 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:36.917627 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-74019b56-7ed6-42c2-bde5-fcaa2105def5 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:36.927989 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74019b56-7ed6-42c2-bde5-fcaa2105def5 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:36.928912 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74019b56-7ed6-42c2-bde5-fcaa2105def5 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:36.930035 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74019b56-7ed6-42c2-bde5-fcaa2105def5 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:36.930960 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74019b56-7ed6-42c2-bde5-fcaa2105def5 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:36.932393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74019b56-7ed6-42c2-bde5-fcaa2105def5 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:36.933282 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74019b56-7ed6-42c2-bde5-fcaa2105def5 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:36.981643 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e037850a-5266-44c3-868a-c8ad3fd7afb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:36.984811 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e037850a-5266-44c3-868a-c8ad3fd7afb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:36.993152 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e037850a-5266-44c3-868a-c8ad3fd7afb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:36.993781 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e037850a-5266-44c3-868a-c8ad3fd7afb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:36.994319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e037850a-5266-44c3-868a-c8ad3fd7afb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:36.995298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e037850a-5266-44c3-868a-c8ad3fd7afb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:36.995852 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e037850a-5266-44c3-868a-c8ad3fd7afb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:36.996647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e037850a-5266-44c3-868a-c8ad3fd7afb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:37.023559 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-e037850a-5266-44c3-868a-c8ad3fd7afb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lazy-loading 'flavor' on Instance uuid dea4f761-54b0-4e77-9d84-5143f79c4e8a {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:34:37.119165 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-74019b56-7ed6-42c2-bde5-fcaa2105def5 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:37.127205 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-74019b56-7ed6-42c2-bde5-fcaa2105def5 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1312 microversion: 2.1 time: 0.219767 Sep 03 01:34:37.142873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 140/289] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:36 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1312 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:37.378242 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e037850a-5266-44c3-868a-c8ad3fd7afb3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "POST /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a/action" status: 200 len: 32 microversion: 2.1 time: 0.401828 Sep 03 01:34:37.379644 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 150/290] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:34:36 2022] POST /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a/action => generated 32 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 03 01:34:37.391718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ec0b66da-7d62-4632-92fa-78cab416bfaf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:37.392663 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ec0b66da-7d62-4632-92fa-78cab416bfaf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:37.402123 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ec0b66da-7d62-4632-92fa-78cab416bfaf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:37.402909 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ec0b66da-7d62-4632-92fa-78cab416bfaf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:37.403540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ec0b66da-7d62-4632-92fa-78cab416bfaf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:37.408468 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ec0b66da-7d62-4632-92fa-78cab416bfaf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:37.408468 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ec0b66da-7d62-4632-92fa-78cab416bfaf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:37.408468 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ec0b66da-7d62-4632-92fa-78cab416bfaf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:37.616831 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ec0b66da-7d62-4632-92fa-78cab416bfaf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:37.624930 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ec0b66da-7d62-4632-92fa-78cab416bfaf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.238501 Sep 03 01:34:37.625567 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 141/291] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:37 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:38.156279 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-dc63416e-3941-4df5-a85f-4b2a204ff925 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:38.157931 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-dc63416e-3941-4df5-a85f-4b2a204ff925 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:38.168611 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=67 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:38.170965 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc63416e-3941-4df5-a85f-4b2a204ff925 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:38.172149 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc63416e-3941-4df5-a85f-4b2a204ff925 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:38.172846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc63416e-3941-4df5-a85f-4b2a204ff925 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:38.173916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc63416e-3941-4df5-a85f-4b2a204ff925 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:38.174607 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc63416e-3941-4df5-a85f-4b2a204ff925 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:38.175363 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc63416e-3941-4df5-a85f-4b2a204ff925 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:38.546661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dc63416e-3941-4df5-a85f-4b2a204ff925 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:38.556236 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-dc63416e-3941-4df5-a85f-4b2a204ff925 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1312 microversion: 2.1 time: 0.408761 Sep 03 01:34:38.556887 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 151/292] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:38 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1312 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:38.643184 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-5b1ca35c-3fdc-4cef-bb3f-c0bc1577192c req-2f732cfc-4185-4f46-b31c-1b71a3a379b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3431986c-9c9f-4d72-8d83-be3e52db81b7", "tag": "32de600c-dba6-45cd-b924-890a48b49b92"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:38.654581 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-749dd75a-83be-48b3-815d-839b2153e250 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:38.659490 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-749dd75a-83be-48b3-815d-839b2153e250 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:38.662556 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-5b1ca35c-3fdc-4cef-bb3f-c0bc1577192c req-2f732cfc-4185-4f46-b31c-1b71a3a379b9 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:38.666163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-5b1ca35c-3fdc-4cef-bb3f-c0bc1577192c req-2f732cfc-4185-4f46-b31c-1b71a3a379b9 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:38.669222 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-5b1ca35c-3fdc-4cef-bb3f-c0bc1577192c req-2f732cfc-4185-4f46-b31c-1b71a3a379b9 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:38.673809 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-749dd75a-83be-48b3-815d-839b2153e250 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:38.674326 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-749dd75a-83be-48b3-815d-839b2153e250 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:38.676110 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-749dd75a-83be-48b3-815d-839b2153e250 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:38.676926 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-749dd75a-83be-48b3-815d-839b2153e250 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:38.677634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-749dd75a-83be-48b3-815d-839b2153e250 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:38.678272 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-749dd75a-83be-48b3-815d-839b2153e250 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:38.728111 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-5b1ca35c-3fdc-4cef-bb3f-c0bc1577192c req-2f732cfc-4185-4f46-b31c-1b71a3a379b9 service nova] Creating event network-changed:32de600c-dba6-45cd-b924-890a48b49b92 for instance 3431986c-9c9f-4d72-8d83-be3e52db81b7 on hv-cinder-83800 Sep 03 01:34:38.735261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-5b1ca35c-3fdc-4cef-bb3f-c0bc1577192c req-2f732cfc-4185-4f46-b31c-1b71a3a379b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095504 Sep 03 01:34:38.736930 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 142/293] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:34:39.023116 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-749dd75a-83be-48b3-815d-839b2153e250 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:39.037052 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-749dd75a-83be-48b3-815d-839b2153e250 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.386005 Sep 03 01:34:39.037649 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 152/294] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:38 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:39.579457 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6339f887-a5ed-438e-a504-3cc82815ef57 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:39.580151 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6339f887-a5ed-438e-a504-3cc82815ef57 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:39.586736 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6339f887-a5ed-438e-a504-3cc82815ef57 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:39.587230 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6339f887-a5ed-438e-a504-3cc82815ef57 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:39.587766 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6339f887-a5ed-438e-a504-3cc82815ef57 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:39.588782 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6339f887-a5ed-438e-a504-3cc82815ef57 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:39.589398 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6339f887-a5ed-438e-a504-3cc82815ef57 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:39.589853 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6339f887-a5ed-438e-a504-3cc82815ef57 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:39.733032 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6339f887-a5ed-438e-a504-3cc82815ef57 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:39.741314 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6339f887-a5ed-438e-a504-3cc82815ef57 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1312 microversion: 2.1 time: 0.166000 Sep 03 01:34:39.746126 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 143/295] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:39 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1312 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:40.061069 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a3348be9-b1ee-4cf2-8b94-86760fef5bb2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:40.061672 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a3348be9-b1ee-4cf2-8b94-86760fef5bb2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:40.067598 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a3348be9-b1ee-4cf2-8b94-86760fef5bb2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:40.068118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a3348be9-b1ee-4cf2-8b94-86760fef5bb2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:40.068551 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a3348be9-b1ee-4cf2-8b94-86760fef5bb2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:40.069223 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a3348be9-b1ee-4cf2-8b94-86760fef5bb2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:40.069663 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a3348be9-b1ee-4cf2-8b94-86760fef5bb2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:40.070085 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a3348be9-b1ee-4cf2-8b94-86760fef5bb2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:40.214220 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a3348be9-b1ee-4cf2-8b94-86760fef5bb2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:40.224556 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a3348be9-b1ee-4cf2-8b94-86760fef5bb2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.167361 Sep 03 01:34:40.225395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 153/296] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:40 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:40.769034 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-80eee771-7666-494a-af86-4d146f102643 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:40.770924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-80eee771-7666-494a-af86-4d146f102643 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:40.780356 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-80eee771-7666-494a-af86-4d146f102643 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:40.781435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-80eee771-7666-494a-af86-4d146f102643 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:40.790987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-80eee771-7666-494a-af86-4d146f102643 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:40.790987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-80eee771-7666-494a-af86-4d146f102643 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:40.790987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-80eee771-7666-494a-af86-4d146f102643 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:40.790987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-80eee771-7666-494a-af86-4d146f102643 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:40.940332 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-80eee771-7666-494a-af86-4d146f102643 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:40.949535 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-80eee771-7666-494a-af86-4d146f102643 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1312 microversion: 2.1 time: 0.186915 Sep 03 01:34:40.950222 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 144/297] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:40 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1312 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:41.248193 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a4bd1003-99d3-4876-8d1e-c97e591bac66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:41.249077 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a4bd1003-99d3-4876-8d1e-c97e591bac66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:41.255903 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a4bd1003-99d3-4876-8d1e-c97e591bac66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:41.256770 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a4bd1003-99d3-4876-8d1e-c97e591bac66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:41.257470 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a4bd1003-99d3-4876-8d1e-c97e591bac66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:41.258265 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a4bd1003-99d3-4876-8d1e-c97e591bac66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:41.258843 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a4bd1003-99d3-4876-8d1e-c97e591bac66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:41.259531 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a4bd1003-99d3-4876-8d1e-c97e591bac66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:41.390129 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a4bd1003-99d3-4876-8d1e-c97e591bac66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:41.398521 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a4bd1003-99d3-4876-8d1e-c97e591bac66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.154211 Sep 03 01:34:41.399184 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 154/298] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:41 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:41.975356 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e1d642a5-99f4-4a4a-b429-a1d7cce866ed tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:41.976021 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e1d642a5-99f4-4a4a-b429-a1d7cce866ed tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:41.982783 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e1d642a5-99f4-4a4a-b429-a1d7cce866ed tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:41.983266 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e1d642a5-99f4-4a4a-b429-a1d7cce866ed tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:41.983695 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e1d642a5-99f4-4a4a-b429-a1d7cce866ed tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:41.984376 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e1d642a5-99f4-4a4a-b429-a1d7cce866ed tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:41.984850 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e1d642a5-99f4-4a4a-b429-a1d7cce866ed tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:41.985272 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e1d642a5-99f4-4a4a-b429-a1d7cce866ed tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:42.015772 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:42.115799 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e1d642a5-99f4-4a4a-b429-a1d7cce866ed tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:42.123952 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e1d642a5-99f4-4a4a-b429-a1d7cce866ed tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1312 microversion: 2.1 time: 0.153270 Sep 03 01:34:42.124533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 145/299] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:41 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:42.422693 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b63603e1-1742-445b-9768-8340d266d27f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:42.424429 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b63603e1-1742-445b-9768-8340d266d27f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:42.431072 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b63603e1-1742-445b-9768-8340d266d27f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:42.431548 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b63603e1-1742-445b-9768-8340d266d27f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:42.431979 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b63603e1-1742-445b-9768-8340d266d27f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:42.432658 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b63603e1-1742-445b-9768-8340d266d27f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:42.433103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b63603e1-1742-445b-9768-8340d266d27f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:42.433528 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b63603e1-1742-445b-9768-8340d266d27f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:42.568397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b63603e1-1742-445b-9768-8340d266d27f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:42.576459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b63603e1-1742-445b-9768-8340d266d27f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.157688 Sep 03 01:34:42.577038 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 155/300] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:42 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:42.953454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-81a0ad23-74fd-476d-9c9b-18ae4b8af3ca tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] Calling method '.version_select at 0x7f6d249fc9d0>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:42.962870 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=8 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:43.011495 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-81a0ad23-74fd-476d-9c9b-18ae4b8af3ca tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/3f47ed7a-c8e4-470d-b2ad-5a74f51b0014" status: 200 len: 351 microversion: 2.1 time: 0.062652 Sep 03 01:34:43.014432 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 146/301] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:34:42 2022] GET /compute/v2.1/os-volumes/3f47ed7a-c8e4-470d-b2ad-5a74f51b0014 => generated 351 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:34:43.147043 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8276c892-57de-4308-97ad-b659406d59fa tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:43.148159 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-8276c892-57de-4308-97ad-b659406d59fa tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:43.154147 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8276c892-57de-4308-97ad-b659406d59fa tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:43.154664 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8276c892-57de-4308-97ad-b659406d59fa tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:43.155105 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8276c892-57de-4308-97ad-b659406d59fa tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:43.156063 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8276c892-57de-4308-97ad-b659406d59fa tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:43.156526 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8276c892-57de-4308-97ad-b659406d59fa tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:43.156944 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8276c892-57de-4308-97ad-b659406d59fa tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:43.178960 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:43.326940 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8276c892-57de-4308-97ad-b659406d59fa tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:43.337431 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-8276c892-57de-4308-97ad-b659406d59fa tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1312 microversion: 2.1 time: 0.192868 Sep 03 01:34:43.338294 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 156/302] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:43 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1312 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:43.599955 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a049d17b-667a-458a-81b5-0c9027306980 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:43.601014 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a049d17b-667a-458a-81b5-0c9027306980 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:43.610126 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a049d17b-667a-458a-81b5-0c9027306980 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:43.610784 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a049d17b-667a-458a-81b5-0c9027306980 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:43.612906 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a049d17b-667a-458a-81b5-0c9027306980 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:43.612906 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a049d17b-667a-458a-81b5-0c9027306980 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:43.612906 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a049d17b-667a-458a-81b5-0c9027306980 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:43.612906 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a049d17b-667a-458a-81b5-0c9027306980 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:43.769428 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a049d17b-667a-458a-81b5-0c9027306980 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:43.778129 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a049d17b-667a-458a-81b5-0c9027306980 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.183008 Sep 03 01:34:43.778777 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 147/303] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:43 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:44.362127 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-aadbf846-8d28-42f0-96fa-fa34acca7758 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:44.362882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-aadbf846-8d28-42f0-96fa-fa34acca7758 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:44.370658 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aadbf846-8d28-42f0-96fa-fa34acca7758 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:44.373138 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aadbf846-8d28-42f0-96fa-fa34acca7758 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:44.373138 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aadbf846-8d28-42f0-96fa-fa34acca7758 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:44.373138 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aadbf846-8d28-42f0-96fa-fa34acca7758 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:44.373138 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aadbf846-8d28-42f0-96fa-fa34acca7758 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:44.373500 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aadbf846-8d28-42f0-96fa-fa34acca7758 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:44.561759 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-aadbf846-8d28-42f0-96fa-fa34acca7758 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:44.570795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-aadbf846-8d28-42f0-96fa-fa34acca7758 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1312 microversion: 2.1 time: 0.213347 Sep 03 01:34:44.571743 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 157/304] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:44 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1312 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:44.666975 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2c3e37db-d192-4ef1-aba2-cd188c868038 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] Calling method '.version_select at 0x7f6d249fc550>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:44.722817 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2c3e37db-d192-4ef1-aba2-cd188c868038 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6cbe868b-b794-47fc-a75a-1dca4e3822ac" status: 200 len: 351 microversion: 2.1 time: 0.059715 Sep 03 01:34:44.728788 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 148/305] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:34:44 2022] GET /compute/v2.1/os-volumes/6cbe868b-b794-47fc-a75a-1dca4e3822ac => generated 351 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:34:44.808042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-916f5fc1-60c5-4b76-a9e6-d8caf59dc2e9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:44.808726 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-916f5fc1-60c5-4b76-a9e6-d8caf59dc2e9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:44.814670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-916f5fc1-60c5-4b76-a9e6-d8caf59dc2e9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:44.815150 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-916f5fc1-60c5-4b76-a9e6-d8caf59dc2e9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:44.815582 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-916f5fc1-60c5-4b76-a9e6-d8caf59dc2e9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:44.816264 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-916f5fc1-60c5-4b76-a9e6-d8caf59dc2e9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:44.816710 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-916f5fc1-60c5-4b76-a9e6-d8caf59dc2e9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:44.817126 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-916f5fc1-60c5-4b76-a9e6-d8caf59dc2e9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:44.968771 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-916f5fc1-60c5-4b76-a9e6-d8caf59dc2e9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:44.973016 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-916f5fc1-60c5-4b76-a9e6-d8caf59dc2e9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.174607 Sep 03 01:34:44.973578 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 158/306] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:44 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:45.136460 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-519b7e2a-a555-479d-b3b0-33d9c14dc219 req-e37c6ca9-bd9f-4e0a-a8c4-e35e729c22bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3431986c-9c9f-4d72-8d83-be3e52db81b7", "name": "network-vif-plugged", "status": "completed", "tag": "32de600c-dba6-45cd-b924-890a48b49b92"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:45.148928 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-519b7e2a-a555-479d-b3b0-33d9c14dc219 req-e37c6ca9-bd9f-4e0a-a8c4-e35e729c22bd service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:45.149475 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-519b7e2a-a555-479d-b3b0-33d9c14dc219 req-e37c6ca9-bd9f-4e0a-a8c4-e35e729c22bd service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:45.149903 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-519b7e2a-a555-479d-b3b0-33d9c14dc219 req-e37c6ca9-bd9f-4e0a-a8c4-e35e729c22bd service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:45.160730 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-519b7e2a-a555-479d-b3b0-33d9c14dc219 req-e37c6ca9-bd9f-4e0a-a8c4-e35e729c22bd service nova] Creating event network-vif-plugged:32de600c-dba6-45cd-b924-890a48b49b92 for instance 3431986c-9c9f-4d72-8d83-be3e52db81b7 on hv-cinder-83800 Sep 03 01:34:45.165902 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-519b7e2a-a555-479d-b3b0-33d9c14dc219 req-e37c6ca9-bd9f-4e0a-a8c4-e35e729c22bd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034161 Sep 03 01:34:45.166691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 149/307] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:34:45.593841 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0095f992-c175-4e2e-9de1-57be15e45b58 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:45.594505 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0095f992-c175-4e2e-9de1-57be15e45b58 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:45.601149 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0095f992-c175-4e2e-9de1-57be15e45b58 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:45.601651 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0095f992-c175-4e2e-9de1-57be15e45b58 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:45.602083 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0095f992-c175-4e2e-9de1-57be15e45b58 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:45.602823 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0095f992-c175-4e2e-9de1-57be15e45b58 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:45.603300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0095f992-c175-4e2e-9de1-57be15e45b58 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:45.603721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0095f992-c175-4e2e-9de1-57be15e45b58 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:45.735847 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0095f992-c175-4e2e-9de1-57be15e45b58 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:45.745028 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0095f992-c175-4e2e-9de1-57be15e45b58 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1312 microversion: 2.1 time: 0.154996 Sep 03 01:34:45.745600 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 159/308] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:45 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1312 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:45.997114 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-356b5b58-8707-414e-90d3-6d68eaa40493 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:45.997812 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-356b5b58-8707-414e-90d3-6d68eaa40493 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:46.004099 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-356b5b58-8707-414e-90d3-6d68eaa40493 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:46.004625 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-356b5b58-8707-414e-90d3-6d68eaa40493 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:46.005103 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-356b5b58-8707-414e-90d3-6d68eaa40493 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:46.005790 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-356b5b58-8707-414e-90d3-6d68eaa40493 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:46.006248 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-356b5b58-8707-414e-90d3-6d68eaa40493 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:46.006994 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-356b5b58-8707-414e-90d3-6d68eaa40493 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:46.137457 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-356b5b58-8707-414e-90d3-6d68eaa40493 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:46.145384 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-356b5b58-8707-414e-90d3-6d68eaa40493 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.152964 Sep 03 01:34:46.145879 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 150/309] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:45 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:46.420296 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8fc683cb-fa66-4f3c-8013-536fa23a501d tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] Calling method '.version_select at 0x7f6d24a7e8b0>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:46.468898 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-8fc683cb-fa66-4f3c-8013-536fa23a501d tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/09667006-923f-4920-b974-b6740596fe97" status: 200 len: 350 microversion: 2.1 time: 0.052256 Sep 03 01:34:46.469473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 160/310] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:34:46 2022] GET /compute/v2.1/os-volumes/09667006-923f-4920-b974-b6740596fe97 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:34:46.482502 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bd7d95f5-61c5-42da-8b35-5cb3713ca39f tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] Calling method '.version_select at 0x7f6d249f99d0>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:46.565130 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bd7d95f5-61c5-42da-8b35-5cb3713ca39f tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086473 Sep 03 01:34:46.565711 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 151/311] 10.222.0.13 () {58 vars in 1134 bytes} [Sat Sep 3 01:34:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:46.580651 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-495b842f-c2e4-49f4-a72a-255996663905 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] Calling method '.version_select at 0x7f6d24a7ea60>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:46.664184 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-495b842f-c2e4-49f4-a72a-255996663905 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087342 Sep 03 01:34:46.664778 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 161/312] 10.222.0.13 () {58 vars in 1149 bytes} [Sat Sep 3 01:34:46 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:34:46.678827 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d2ac1d87-852e-4433-bebf-7d66cfd3cfc2 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] Calling method '.version_select at 0x7f6d24b08790>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:46.760101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d2ac1d87-852e-4433-bebf-7d66cfd3cfc2 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.085600 Sep 03 01:34:46.760664 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 152/313] 10.222.0.13 () {58 vars in 1134 bytes} [Sat Sep 3 01:34:46 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:46.767342 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3f5edfa1-d436-4e4f-8e07-016191026ed6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:46.768121 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-3f5edfa1-d436-4e4f-8e07-016191026ed6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:46.773569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e3124256-98c6-4112-b36d-b7a0f5f979f2 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] Calling method '.version_select at 0x7f6d249fc820>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:46.775476 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3f5edfa1-d436-4e4f-8e07-016191026ed6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:46.775961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3f5edfa1-d436-4e4f-8e07-016191026ed6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:46.776390 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3f5edfa1-d436-4e4f-8e07-016191026ed6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:46.777076 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3f5edfa1-d436-4e4f-8e07-016191026ed6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:46.777514 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3f5edfa1-d436-4e4f-8e07-016191026ed6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:46.777942 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3f5edfa1-d436-4e4f-8e07-016191026ed6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:46.860564 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e3124256-98c6-4112-b36d-b7a0f5f979f2 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090601 Sep 03 01:34:46.861227 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 153/314] 10.222.0.13 () {58 vars in 1167 bytes} [Sat Sep 3 01:34:46 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:34:46.875563 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-89005b7c-7ab5-41f4-8847-99391110126d tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] Calling method '.version_select at 0x7f6d249f9040>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:46.921519 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3f5edfa1-d436-4e4f-8e07-016191026ed6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:46.930645 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3f5edfa1-d436-4e4f-8e07-016191026ed6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1312 microversion: 2.1 time: 0.166927 Sep 03 01:34:46.932595 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 162/315] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:46 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1312 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:46.973762 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-89005b7c-7ab5-41f4-8847-99391110126d tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.102165 Sep 03 01:34:46.974330 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 154/316] 10.222.0.13 () {58 vars in 1170 bytes} [Sat Sep 3 01:34:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:34:46.989011 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7aff1478-2678-48b0-b1c5-82f1d4c8df87 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] Calling method '.version_select at 0x7f6d24b074c0>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:47.073369 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7aff1478-2678-48b0-b1c5-82f1d4c8df87 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088034 Sep 03 01:34:47.073940 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 163/317] 10.222.0.13 () {58 vars in 1155 bytes} [Sat Sep 3 01:34:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:47.088119 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-50e7df82-b08b-4279-9c31-6536c3a7b045 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] Calling method '.version_select at 0x7f6d24a02820>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:47.172082 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-458c5eeb-32ed-400b-8de1-afc23e8b9fc1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:47.172770 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-458c5eeb-32ed-400b-8de1-afc23e8b9fc1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:47.174259 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-50e7df82-b08b-4279-9c31-6536c3a7b045 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.090532 Sep 03 01:34:47.174638 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 155/318] 10.222.0.13 () {58 vars in 1188 bytes} [Sat Sep 3 01:34:47 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:34:47.180865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-458c5eeb-32ed-400b-8de1-afc23e8b9fc1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:47.181357 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-458c5eeb-32ed-400b-8de1-afc23e8b9fc1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:47.181794 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-458c5eeb-32ed-400b-8de1-afc23e8b9fc1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:47.182577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-458c5eeb-32ed-400b-8de1-afc23e8b9fc1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:47.183094 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-458c5eeb-32ed-400b-8de1-afc23e8b9fc1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:47.183519 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-458c5eeb-32ed-400b-8de1-afc23e8b9fc1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:47.189011 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-15a89865-4117-4a07-a8dc-5ab2b0564715 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] Calling method '.version_select at 0x7f6d261538b0>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:47.271823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-15a89865-4117-4a07-a8dc-5ab2b0564715 tempest-VolumesTestJSON-208439191 tempest-VolumesTestJSON-208439191-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086472 Sep 03 01:34:47.273364 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 156/319] 10.222.0.13 () {58 vars in 1155 bytes} [Sat Sep 3 01:34:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:47.326990 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-458c5eeb-32ed-400b-8de1-afc23e8b9fc1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:47.335200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-458c5eeb-32ed-400b-8de1-afc23e8b9fc1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.168659 Sep 03 01:34:47.335808 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 164/320] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:47 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:47.961990 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-25056f78-f280-42df-ae61-ddf575feb74e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:47.962619 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-25056f78-f280-42df-ae61-ddf575feb74e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:47.978405 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25056f78-f280-42df-ae61-ddf575feb74e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:47.978405 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25056f78-f280-42df-ae61-ddf575feb74e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:47.978405 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25056f78-f280-42df-ae61-ddf575feb74e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:47.978405 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25056f78-f280-42df-ae61-ddf575feb74e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:47.979093 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25056f78-f280-42df-ae61-ddf575feb74e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:47.979093 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25056f78-f280-42df-ae61-ddf575feb74e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:48.109884 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-25056f78-f280-42df-ae61-ddf575feb74e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:48.118657 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-25056f78-f280-42df-ae61-ddf575feb74e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1496 microversion: 2.1 time: 0.161821 Sep 03 01:34:48.119238 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 157/321] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:47 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1496 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:48.364247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-edf9aaa1-a642-46ec-9261-2444ca76ba07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:48.364960 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-edf9aaa1-a642-46ec-9261-2444ca76ba07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:48.371857 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf9aaa1-a642-46ec-9261-2444ca76ba07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:48.372337 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf9aaa1-a642-46ec-9261-2444ca76ba07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:48.372766 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf9aaa1-a642-46ec-9261-2444ca76ba07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:48.374120 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf9aaa1-a642-46ec-9261-2444ca76ba07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:48.374120 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf9aaa1-a642-46ec-9261-2444ca76ba07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:48.374362 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf9aaa1-a642-46ec-9261-2444ca76ba07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:48.508092 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-edf9aaa1-a642-46ec-9261-2444ca76ba07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:48.517655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-edf9aaa1-a642-46ec-9261-2444ca76ba07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.157346 Sep 03 01:34:48.518234 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 165/322] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:48 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:49.275376 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-353a7015-695c-43f6-b3c7-7515317c81de tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:49.275972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-353a7015-695c-43f6-b3c7-7515317c81de tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:49.283129 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-353a7015-695c-43f6-b3c7-7515317c81de tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:49.283610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-353a7015-695c-43f6-b3c7-7515317c81de tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:49.284037 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-353a7015-695c-43f6-b3c7-7515317c81de tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:49.284784 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-353a7015-695c-43f6-b3c7-7515317c81de tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:49.285229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-353a7015-695c-43f6-b3c7-7515317c81de tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:49.285647 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-353a7015-695c-43f6-b3c7-7515317c81de tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:49.312451 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-353a7015-695c-43f6-b3c7-7515317c81de tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:34:49.540864 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ae4f5aef-db04-46b0-8927-bb4c9fdf92d3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:49.541467 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ae4f5aef-db04-46b0-8927-bb4c9fdf92d3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:49.547887 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae4f5aef-db04-46b0-8927-bb4c9fdf92d3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:49.548369 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae4f5aef-db04-46b0-8927-bb4c9fdf92d3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:49.548804 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae4f5aef-db04-46b0-8927-bb4c9fdf92d3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:49.549621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae4f5aef-db04-46b0-8927-bb4c9fdf92d3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:49.550073 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae4f5aef-db04-46b0-8927-bb4c9fdf92d3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:49.550526 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae4f5aef-db04-46b0-8927-bb4c9fdf92d3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:49.630080 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-353a7015-695c-43f6-b3c7-7515317c81de tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 204 len: 0 microversion: 2.1 time: 0.358388 Sep 03 01:34:49.630703 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 158/323] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:34:49 2022] DELETE /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:34:49.641092 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-3e3213ac-7dd2-42d3-876d-209c2b77096e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:49.641866 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-3e3213ac-7dd2-42d3-876d-209c2b77096e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:49.648586 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e3213ac-7dd2-42d3-876d-209c2b77096e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:49.661281 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e3213ac-7dd2-42d3-876d-209c2b77096e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:49.661281 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e3213ac-7dd2-42d3-876d-209c2b77096e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:49.661281 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e3213ac-7dd2-42d3-876d-209c2b77096e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:49.661281 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e3213ac-7dd2-42d3-876d-209c2b77096e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:49.661710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e3213ac-7dd2-42d3-876d-209c2b77096e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:49.684621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ae4f5aef-db04-46b0-8927-bb4c9fdf92d3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:49.692675 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ae4f5aef-db04-46b0-8927-bb4c9fdf92d3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.156299 Sep 03 01:34:49.693254 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 166/324] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:49 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:49.792844 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-3e3213ac-7dd2-42d3-876d-209c2b77096e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:49.800860 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-3e3213ac-7dd2-42d3-876d-209c2b77096e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1502 microversion: 2.1 time: 0.165116 Sep 03 01:34:49.801439 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 159/325] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:49 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1502 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:50.716203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0f1066c2-b6ef-473a-b443-a67cbb9265d5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:50.717436 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0f1066c2-b6ef-473a-b443-a67cbb9265d5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:50.726138 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f1066c2-b6ef-473a-b443-a67cbb9265d5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:50.726866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f1066c2-b6ef-473a-b443-a67cbb9265d5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:50.727304 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f1066c2-b6ef-473a-b443-a67cbb9265d5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:50.728106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f1066c2-b6ef-473a-b443-a67cbb9265d5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:50.728560 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f1066c2-b6ef-473a-b443-a67cbb9265d5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:50.728986 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f1066c2-b6ef-473a-b443-a67cbb9265d5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:50.829868 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-3740d90b-1314-4cc7-b888-2fd06ac7d1c6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:50.831238 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-3740d90b-1314-4cc7-b888-2fd06ac7d1c6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:50.840381 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3740d90b-1314-4cc7-b888-2fd06ac7d1c6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:50.841099 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3740d90b-1314-4cc7-b888-2fd06ac7d1c6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:50.841631 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3740d90b-1314-4cc7-b888-2fd06ac7d1c6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:50.842599 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3740d90b-1314-4cc7-b888-2fd06ac7d1c6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:50.843413 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3740d90b-1314-4cc7-b888-2fd06ac7d1c6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:50.843716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3740d90b-1314-4cc7-b888-2fd06ac7d1c6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:50.888209 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0f1066c2-b6ef-473a-b443-a67cbb9265d5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:50.899110 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0f1066c2-b6ef-473a-b443-a67cbb9265d5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.186875 Sep 03 01:34:50.899685 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 167/326] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:50 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:50.979471 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-3740d90b-1314-4cc7-b888-2fd06ac7d1c6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:50.983091 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:50.987532 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-3740d90b-1314-4cc7-b888-2fd06ac7d1c6 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1502 microversion: 2.1 time: 0.166017 Sep 03 01:34:50.988192 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 160/327] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:50 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:51.928242 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3aeefbc7-933f-4dad-9bed-c3270f4ef555 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:51.928946 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-3aeefbc7-933f-4dad-9bed-c3270f4ef555 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:51.946593 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3aeefbc7-933f-4dad-9bed-c3270f4ef555 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:51.946593 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3aeefbc7-933f-4dad-9bed-c3270f4ef555 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:51.946593 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3aeefbc7-933f-4dad-9bed-c3270f4ef555 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:51.946593 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3aeefbc7-933f-4dad-9bed-c3270f4ef555 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:51.947003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3aeefbc7-933f-4dad-9bed-c3270f4ef555 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:51.947003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3aeefbc7-933f-4dad-9bed-c3270f4ef555 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:52.011223 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c285ab9e-d46b-4297-9c3a-fbf220be9a39 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:52.011825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c285ab9e-d46b-4297-9c3a-fbf220be9a39 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:52.018974 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c285ab9e-d46b-4297-9c3a-fbf220be9a39 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:52.019458 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c285ab9e-d46b-4297-9c3a-fbf220be9a39 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:52.019888 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c285ab9e-d46b-4297-9c3a-fbf220be9a39 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:52.020583 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c285ab9e-d46b-4297-9c3a-fbf220be9a39 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:52.021028 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c285ab9e-d46b-4297-9c3a-fbf220be9a39 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:52.021448 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c285ab9e-d46b-4297-9c3a-fbf220be9a39 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:52.079518 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3aeefbc7-933f-4dad-9bed-c3270f4ef555 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:52.087811 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3aeefbc7-933f-4dad-9bed-c3270f4ef555 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.163547 Sep 03 01:34:52.088379 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 168/328] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:51 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:52.154852 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c285ab9e-d46b-4297-9c3a-fbf220be9a39 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:52.162886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c285ab9e-d46b-4297-9c3a-fbf220be9a39 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1502 microversion: 2.1 time: 0.155435 Sep 03 01:34:52.163546 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 161/329] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:52 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:53.110538 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-618681da-c96c-4994-a131-0fe83c4455a8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:53.111079 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-618681da-c96c-4994-a131-0fe83c4455a8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:53.117325 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-618681da-c96c-4994-a131-0fe83c4455a8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:53.117811 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-618681da-c96c-4994-a131-0fe83c4455a8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:53.118255 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-618681da-c96c-4994-a131-0fe83c4455a8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:53.118965 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-618681da-c96c-4994-a131-0fe83c4455a8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:53.119423 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-618681da-c96c-4994-a131-0fe83c4455a8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:53.119870 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-618681da-c96c-4994-a131-0fe83c4455a8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:53.186306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-74a1b7e5-57f6-44e8-aacd-02cf6796616c tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:53.187023 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-74a1b7e5-57f6-44e8-aacd-02cf6796616c tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:53.193434 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74a1b7e5-57f6-44e8-aacd-02cf6796616c tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:53.195127 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74a1b7e5-57f6-44e8-aacd-02cf6796616c tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:53.195558 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74a1b7e5-57f6-44e8-aacd-02cf6796616c tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:53.196247 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74a1b7e5-57f6-44e8-aacd-02cf6796616c tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:53.196698 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74a1b7e5-57f6-44e8-aacd-02cf6796616c tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:53.197116 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74a1b7e5-57f6-44e8-aacd-02cf6796616c tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:53.289901 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-618681da-c96c-4994-a131-0fe83c4455a8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:53.297607 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-618681da-c96c-4994-a131-0fe83c4455a8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.191019 Sep 03 01:34:53.298174 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 169/330] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:53 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:53.329933 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-74a1b7e5-57f6-44e8-aacd-02cf6796616c tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:53.337556 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-74a1b7e5-57f6-44e8-aacd-02cf6796616c tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1502 microversion: 2.1 time: 0.155139 Sep 03 01:34:53.338126 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 162/331] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:53 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:54.325179 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f3bc236c-1fd3-44ff-b7fc-f053adf4d94f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:54.325928 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f3bc236c-1fd3-44ff-b7fc-f053adf4d94f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:54.331912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f3bc236c-1fd3-44ff-b7fc-f053adf4d94f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:54.333760 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f3bc236c-1fd3-44ff-b7fc-f053adf4d94f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:54.333760 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f3bc236c-1fd3-44ff-b7fc-f053adf4d94f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:54.333760 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f3bc236c-1fd3-44ff-b7fc-f053adf4d94f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:54.334204 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f3bc236c-1fd3-44ff-b7fc-f053adf4d94f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:54.334345 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f3bc236c-1fd3-44ff-b7fc-f053adf4d94f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:54.360748 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a9462414-bc69-4e95-8bdf-53744c1a0d02 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:54.361416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a9462414-bc69-4e95-8bdf-53744c1a0d02 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:54.365066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:54.369556 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a9462414-bc69-4e95-8bdf-53744c1a0d02 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:54.370042 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a9462414-bc69-4e95-8bdf-53744c1a0d02 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:54.370642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a9462414-bc69-4e95-8bdf-53744c1a0d02 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:54.371351 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a9462414-bc69-4e95-8bdf-53744c1a0d02 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:54.371802 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a9462414-bc69-4e95-8bdf-53744c1a0d02 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:54.372226 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a9462414-bc69-4e95-8bdf-53744c1a0d02 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:54.509781 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a9462414-bc69-4e95-8bdf-53744c1a0d02 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:54.517541 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a9462414-bc69-4e95-8bdf-53744c1a0d02 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1502 microversion: 2.1 time: 0.161134 Sep 03 01:34:54.518109 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 163/332] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:54 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:54.547092 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f3bc236c-1fd3-44ff-b7fc-f053adf4d94f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:54.555233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f3bc236c-1fd3-44ff-b7fc-f053adf4d94f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.233849 Sep 03 01:34:54.555818 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 170/333] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:54 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:54.887160 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-e48bf754-ae3d-4b97-a6a1-494a5d1c4226 req-a150cb31-1e50-45cd-b9ae-92ea329af343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3431986c-9c9f-4d72-8d83-be3e52db81b7", "name": "network-vif-deleted", "tag": "32de600c-dba6-45cd-b924-890a48b49b92"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:54.897282 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-e48bf754-ae3d-4b97-a6a1-494a5d1c4226 req-a150cb31-1e50-45cd-b9ae-92ea329af343 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:54.897758 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-e48bf754-ae3d-4b97-a6a1-494a5d1c4226 req-a150cb31-1e50-45cd-b9ae-92ea329af343 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:54.898190 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-e48bf754-ae3d-4b97-a6a1-494a5d1c4226 req-a150cb31-1e50-45cd-b9ae-92ea329af343 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:54.909418 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-e48bf754-ae3d-4b97-a6a1-494a5d1c4226 req-a150cb31-1e50-45cd-b9ae-92ea329af343 service nova] Creating event network-vif-deleted:32de600c-dba6-45cd-b924-890a48b49b92 for instance 3431986c-9c9f-4d72-8d83-be3e52db81b7 on hv-cinder-83800 Sep 03 01:34:54.914199 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-e48bf754-ae3d-4b97-a6a1-494a5d1c4226 req-a150cb31-1e50-45cd-b9ae-92ea329af343 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030716 Sep 03 01:34:54.914827 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 164/334] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:34:55.541302 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:55.541948 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:55.548266 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:55.548741 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:55.549168 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:55.549838 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:55.550281 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:55.550810 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:55.582665 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:55.583139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:55.583570 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:55.584541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lazy-loading 'fault' on Instance uuid 3431986c-9c9f-4d72-8d83-be3e52db81b7 {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:34:55.587485 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7512dd16-6ec1-4441-bf1f-9188ce7aa2d6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:55.588253 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7512dd16-6ec1-4441-bf1f-9188ce7aa2d6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:55.594589 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7512dd16-6ec1-4441-bf1f-9188ce7aa2d6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:55.595232 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7512dd16-6ec1-4441-bf1f-9188ce7aa2d6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:55.595674 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7512dd16-6ec1-4441-bf1f-9188ce7aa2d6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:55.596372 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7512dd16-6ec1-4441-bf1f-9188ce7aa2d6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:55.596835 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7512dd16-6ec1-4441-bf1f-9188ce7aa2d6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:55.597259 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7512dd16-6ec1-4441-bf1f-9188ce7aa2d6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:55.632947 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:55.658648 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-63655bc1-bb02-403e-ad70-5c050af13f72 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 200 len: 1302 microversion: 2.1 time: 0.120368 Sep 03 01:34:55.661232 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 171/335] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:55 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 1302 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:55.793808 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7512dd16-6ec1-4441-bf1f-9188ce7aa2d6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:55.802209 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7512dd16-6ec1-4441-bf1f-9188ce7aa2d6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1501 microversion: 2.1 time: 0.220835 Sep 03 01:34:55.803710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 165/336] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:55 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1501 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:55.826601 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-569e563b-e14d-4d90-bf62-2c4796c89a73 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1cc6388f-52ad-4019-b048-174fcfabbb92"}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:55.828964 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-569e563b-e14d-4d90-bf62-2c4796c89a73 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:55.836551 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-569e563b-e14d-4d90-bf62-2c4796c89a73 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:55.837055 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-569e563b-e14d-4d90-bf62-2c4796c89a73 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:55.837479 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-569e563b-e14d-4d90-bf62-2c4796c89a73 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:55.838490 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-569e563b-e14d-4d90-bf62-2c4796c89a73 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:55.838980 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-569e563b-e14d-4d90-bf62-2c4796c89a73 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:55.839442 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-569e563b-e14d-4d90-bf62-2c4796c89a73 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:55.866282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-569e563b-e14d-4d90-bf62-2c4796c89a73 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] HTTP exception thrown: Cannot 'attach_volume' instance dea4f761-54b0-4e77-9d84-5143f79c4e8a while it is in vm_state rescued Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-569e563b-e14d-4d90-bf62-2c4796c89a73 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Request method failure captured: Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: POST /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a/os-volume_attachments HTTP/1.1 Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 74 Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7V2ath9gf-whD6tL86b1S7pYvql4QgUyJF1yPAVzgiQ2t6IoM2RYz54SA6JROlCBu6uMndk0hzOd9Xac4ZVRZsWa_GZPp5YK22x3_vfwipYUfM5-C8aj-iUUgX169mfrwWeU8PgX6mea_qND-4fnQAWZMLQqNrq4pPhzc49V3gV8w Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: d93c5a3ef20c4a5b87af4803f820b60e Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:34:55.868540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:34:55.870068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:34:55.870068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:34:55.870068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: d93c5a3ef20c4a5b87af4803f820b60e Sep 03 01:34:55.870068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:34:55.870068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-ServerRescueNegativeTestJSON-201019967-project Sep 03 01:34:55.870068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:34:55.870068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:34:55.870068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 409c324dca974d9dad9529b2a0d82b30 Sep 03 01:34:55.870068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201019967-project Sep 03 01:34:55.870068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Sep 03 01:34:55.870068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {"volumeAttachment": {"volumeId": "1cc6388f-52ad-4019-b048-174fcfabbb92"}} Sep 03 01:34:55.870068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Cannot 'attach_volume' instance dea4f761-54b0-4e77-9d84-5143f79c4e8a while it is in vm_state rescued Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'server_id': 'dea4f761-54b0-4e77-9d84-5143f79c4e8a', 'body': {'volumeAttachment': {'volumeId': '1cc6388f-52ad-4019-b048-174fcfabbb92'}}} Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance dea4f761-54b0-4e77-9d84-5143f79c4e8a in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:34:55.871056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance dea4f761-54b0-4e77-9d84-5143f79c4e8a while it is in vm_state rescued Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:34:55.872576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:34:55.874073 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:34:55.874073 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:34:55.874073 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance dea4f761-54b0-4e77-9d84-5143f79c4e8a while it is in vm_state rescued Sep 03 01:34:55.874073 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:34:55.875013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-569e563b-e14d-4d90-bf62-2c4796c89a73 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Returning 409 to user: Cannot 'attach_volume' instance dea4f761-54b0-4e77-9d84-5143f79c4e8a while it is in vm_state rescued {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:34:55.876011 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-569e563b-e14d-4d90-bf62-2c4796c89a73 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "POST /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053728 Sep 03 01:34:55.876699 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 172/337] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:34:55 2022] POST /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a/os-volume_attachments => generated 152 bytes in 55 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 01:34:55.886292 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-36ba5603-5364-45ea-addc-2cd3d26256dd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:55.886831 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-36ba5603-5364-45ea-addc-2cd3d26256dd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:55.892643 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-36ba5603-5364-45ea-addc-2cd3d26256dd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:55.893132 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-36ba5603-5364-45ea-addc-2cd3d26256dd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:55.893572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-36ba5603-5364-45ea-addc-2cd3d26256dd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:55.894263 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-36ba5603-5364-45ea-addc-2cd3d26256dd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:55.894750 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-36ba5603-5364-45ea-addc-2cd3d26256dd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:55.895233 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-36ba5603-5364-45ea-addc-2cd3d26256dd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:56.130648 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-36ba5603-5364-45ea-addc-2cd3d26256dd tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "POST /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a/action" status: 202 len: 0 microversion: 2.1 time: 0.248398 Sep 03 01:34:56.133792 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 166/338] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:34:55 2022] POST /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:34:56.147580 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0465f5f3-2d09-4b46-bdba-88325d0097f9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:56.148474 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0465f5f3-2d09-4b46-bdba-88325d0097f9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:56.156316 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0465f5f3-2d09-4b46-bdba-88325d0097f9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:56.157016 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0465f5f3-2d09-4b46-bdba-88325d0097f9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:56.157521 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0465f5f3-2d09-4b46-bdba-88325d0097f9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:56.158281 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0465f5f3-2d09-4b46-bdba-88325d0097f9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:56.158830 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0465f5f3-2d09-4b46-bdba-88325d0097f9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:56.159322 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0465f5f3-2d09-4b46-bdba-88325d0097f9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:56.378865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0465f5f3-2d09-4b46-bdba-88325d0097f9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:56.387109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0465f5f3-2d09-4b46-bdba-88325d0097f9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1509 microversion: 2.1 time: 0.246558 Sep 03 01:34:56.387767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 173/339] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:56 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1509 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:56.686615 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6e341895-21c2-45ff-8512-02c77a5507bc tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:56.687461 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6e341895-21c2-45ff-8512-02c77a5507bc tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 3431986c-9c9f-4d72-8d83-be3e52db81b7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:56.694936 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6e341895-21c2-45ff-8512-02c77a5507bc tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:56.695519 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6e341895-21c2-45ff-8512-02c77a5507bc tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:56.699501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6e341895-21c2-45ff-8512-02c77a5507bc tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:56.699501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6e341895-21c2-45ff-8512-02c77a5507bc tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:56.699501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6e341895-21c2-45ff-8512-02c77a5507bc tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:56.699501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6e341895-21c2-45ff-8512-02c77a5507bc tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:56.713944 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-6e341895-21c2-45ff-8512-02c77a5507bc tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] HTTP exception thrown: Instance 3431986c-9c9f-4d72-8d83-be3e52db81b7 could not be found. Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6e341895-21c2-45ff-8512-02c77a5507bc tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Request method failure captured: Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 HTTP/1.1 Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq8l2A7zfk7v8zd_3hB9n26qQun4vXLtuMsTHcI-8Eqzz-QCmk8CqTqAxYtP-wprfIsDW1R4wBmAUXhOZSF3k1IDmbjMZUSRM6qRpFkBy8H4iYF3joEZJkeT4JljXlA9fwIuHCAeph8iAHc8oBjakenpYjdoMHCzHIAWXnTyllhM3rY Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: efd244ba290249568e3a6f8bd3e7e814 Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-VolumesActionsTest-1108292238 Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:34:56.715741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:34:56.717137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_efd244ba290249568e3a6f8bd3e7e814"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/efd244ba290249568e3a6f8bd3e7e814"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/efd244ba290249568e3a6f8bd3e7e814"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/efd244ba290249568e3a6f8bd3e7e814"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:34:56.717137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-VolumesActionsTest-1108292238 Sep 03 01:34:56.717137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: efd244ba290249568e3a6f8bd3e7e814 Sep 03 01:34:56.717137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-VolumesActionsTest-1108292238 Sep 03 01:34:56.717137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-VolumesActionsTest-1108292238-project Sep 03 01:34:56.717137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:34:56.717137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:34:56.717137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 205b8f60af7a4957a578f21f9ea464dd Sep 03 01:34:56.717137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-VolumesActionsTest-1108292238-project Sep 03 01:34:56.717137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:34:56.717137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 3431986c-9c9f-4d72-8d83-be3e52db81b7 could not be found. Sep 03 01:34:56.717137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '3431986c-9c9f-4d72-8d83-be3e52db81b7'} Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3431986c-9c9f-4d72-8d83-be3e52db81b7 could not be found. Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:34:56.717920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3431986c-9c9f-4d72-8d83-be3e52db81b7 could not be found. Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3431986c-9c9f-4d72-8d83-be3e52db81b7 could not be found. Sep 03 01:34:56.719277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:34:56.720378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6e341895-21c2-45ff-8512-02c77a5507bc tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Returning 404 to user: Instance 3431986c-9c9f-4d72-8d83-be3e52db81b7 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:34:56.720378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6e341895-21c2-45ff-8512-02c77a5507bc tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7" status: 404 len: 111 microversion: 2.1 time: 0.036447 Sep 03 01:34:56.720378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 167/340] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:56 2022] GET /compute/v2.1/servers/3431986c-9c9f-4d72-8d83-be3e52db81b7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:34:56.893460 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-370101863", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "networks": [{"uuid": "64961fe8-d6d6-4f3f-97ee-ec37229fbea7"}]}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:34:56.969419 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.network.neutron [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] validate_networks() for [('64961fe8-d6d6-4f3f-97ee-ec37229fbea7', None, None, None, None, None)] {{(pid=127552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:34:57.352815 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Flavor limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:34:57.353234 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Image limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:34:57.353729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Flavor pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:34:57.354130 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Image pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:34:57.354576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:34:57.370677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:57.371388 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:57.371842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:57.372561 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:57.373005 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:57.373427 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:57.390055 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Getting quotas for project efd244ba290249568e3a6f8bd3e7e814. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:34:57.394362 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Getting quotas for user 205b8f60af7a4957a578f21f9ea464dd and project efd244ba290249568e3a6f8bd3e7e814. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:34:57.410619 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ae4c2c86-138d-488c-8672-bb9af9dff8e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:57.411159 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ae4c2c86-138d-488c-8672-bb9af9dff8e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:57.416064 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Going to run 1 instances... {{(pid=127552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:34:57.418323 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae4c2c86-138d-488c-8672-bb9af9dff8e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:57.418474 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:34:57.418842 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae4c2c86-138d-488c-8672-bb9af9dff8e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:57.419278 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae4c2c86-138d-488c-8672-bb9af9dff8e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:57.419994 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae4c2c86-138d-488c-8672-bb9af9dff8e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:57.420609 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae4c2c86-138d-488c-8672-bb9af9dff8e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:57.421017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae4c2c86-138d-488c-8672-bb9af9dff8e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:57.565991 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-036e0dc9-1c70-42c7-bd21-01ea4c4e868e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676931 Sep 03 01:34:57.566672 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 174/341] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:34:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:34:57.573035 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ae4c2c86-138d-488c-8672-bb9af9dff8e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:57.579753 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d5aa61eb-c820-4a61-b803-39e9122caf1a tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:57.580372 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d5aa61eb-c820-4a61-b803-39e9122caf1a tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:57.583121 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ae4c2c86-138d-488c-8672-bb9af9dff8e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1509 microversion: 2.1 time: 0.176349 Sep 03 01:34:57.584091 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 168/342] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:57 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1509 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:57.648504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d5aa61eb-c820-4a61-b803-39e9122caf1a tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:57.656267 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d5aa61eb-c820-4a61-b803-39e9122caf1a tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1213 microversion: 2.1 time: 0.080422 Sep 03 01:34:57.657022 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 175/343] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:57 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:58.606867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-fe32fce1-559e-4c57-8f60-c4244be20829 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:58.607544 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-fe32fce1-559e-4c57-8f60-c4244be20829 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:58.615175 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fe32fce1-559e-4c57-8f60-c4244be20829 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:58.616677 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fe32fce1-559e-4c57-8f60-c4244be20829 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:58.617404 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fe32fce1-559e-4c57-8f60-c4244be20829 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:58.618323 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fe32fce1-559e-4c57-8f60-c4244be20829 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:58.618831 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fe32fce1-559e-4c57-8f60-c4244be20829 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:58.619263 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fe32fce1-559e-4c57-8f60-c4244be20829 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:58.681391 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-1598fdeb-8b18-4346-be25-13967c370b73 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:58.682001 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-1598fdeb-8b18-4346-be25-13967c370b73 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:58.689034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1598fdeb-8b18-4346-be25-13967c370b73 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:58.689516 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1598fdeb-8b18-4346-be25-13967c370b73 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:58.689949 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1598fdeb-8b18-4346-be25-13967c370b73 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:58.690731 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1598fdeb-8b18-4346-be25-13967c370b73 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:58.691182 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1598fdeb-8b18-4346-be25-13967c370b73 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:58.691604 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1598fdeb-8b18-4346-be25-13967c370b73 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:58.754325 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1598fdeb-8b18-4346-be25-13967c370b73 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:58.763732 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-1598fdeb-8b18-4346-be25-13967c370b73 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1217 microversion: 2.1 time: 0.086881 Sep 03 01:34:58.764678 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 176/344] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:58 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1217 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:34:58.774659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-fe32fce1-559e-4c57-8f60-c4244be20829 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:58.792600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-fe32fce1-559e-4c57-8f60-c4244be20829 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1509 microversion: 2.1 time: 0.189993 Sep 03 01:34:58.802238 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 169/345] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:58 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1509 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:59.788459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e82418db-e14a-48a1-92fa-d86e4ae62119 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:59.789008 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e82418db-e14a-48a1-92fa-d86e4ae62119 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:59.795016 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e82418db-e14a-48a1-92fa-d86e4ae62119 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:59.795557 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e82418db-e14a-48a1-92fa-d86e4ae62119 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:59.796028 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e82418db-e14a-48a1-92fa-d86e4ae62119 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:59.796719 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e82418db-e14a-48a1-92fa-d86e4ae62119 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:59.797172 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e82418db-e14a-48a1-92fa-d86e4ae62119 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:59.797629 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e82418db-e14a-48a1-92fa-d86e4ae62119 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:59.816284 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0ebd86f9-8dcf-4123-b521-6bb9d356bd90 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:34:59.816919 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-0ebd86f9-8dcf-4123-b521-6bb9d356bd90 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:34:59.824756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0ebd86f9-8dcf-4123-b521-6bb9d356bd90 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:59.825558 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0ebd86f9-8dcf-4123-b521-6bb9d356bd90 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:59.826061 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0ebd86f9-8dcf-4123-b521-6bb9d356bd90 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:59.826866 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0ebd86f9-8dcf-4123-b521-6bb9d356bd90 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:34:59.827448 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0ebd86f9-8dcf-4123-b521-6bb9d356bd90 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:34:59.827873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0ebd86f9-8dcf-4123-b521-6bb9d356bd90 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:34:59.868836 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e82418db-e14a-48a1-92fa-d86e4ae62119 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:34:59.872212 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:34:59.877181 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e82418db-e14a-48a1-92fa-d86e4ae62119 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1209 microversion: 2.1 time: 0.093425 Sep 03 01:34:59.878141 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 177/346] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:59 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:34:59.998137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-0ebd86f9-8dcf-4123-b521-6bb9d356bd90 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:00.006413 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0ebd86f9-8dcf-4123-b521-6bb9d356bd90 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1515 microversion: 2.1 time: 0.193584 Sep 03 01:35:00.006974 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 170/347] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:34:59 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1515 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:35:00.901865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b1de8a34-a7a5-4d83-a807-4007819f858f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:00.902503 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b1de8a34-a7a5-4d83-a807-4007819f858f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:00.908958 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b1de8a34-a7a5-4d83-a807-4007819f858f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:00.909447 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b1de8a34-a7a5-4d83-a807-4007819f858f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:00.909874 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b1de8a34-a7a5-4d83-a807-4007819f858f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:00.910588 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b1de8a34-a7a5-4d83-a807-4007819f858f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:00.911044 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b1de8a34-a7a5-4d83-a807-4007819f858f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:00.911469 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b1de8a34-a7a5-4d83-a807-4007819f858f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:00.972839 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b1de8a34-a7a5-4d83-a807-4007819f858f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:00.980925 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b1de8a34-a7a5-4d83-a807-4007819f858f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1209 microversion: 2.1 time: 0.083960 Sep 03 01:35:00.981713 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 178/348] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:00 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:02.003302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f1018e4a-34b0-4ac4-996d-e46e6bb79245 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:02.003916 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f1018e4a-34b0-4ac4-996d-e46e6bb79245 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:02.011619 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f1018e4a-34b0-4ac4-996d-e46e6bb79245 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:02.012100 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f1018e4a-34b0-4ac4-996d-e46e6bb79245 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:02.012542 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f1018e4a-34b0-4ac4-996d-e46e6bb79245 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:02.017524 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f1018e4a-34b0-4ac4-996d-e46e6bb79245 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:02.017524 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f1018e4a-34b0-4ac4-996d-e46e6bb79245 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:02.017524 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f1018e4a-34b0-4ac4-996d-e46e6bb79245 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:02.081265 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-f1018e4a-34b0-4ac4-996d-e46e6bb79245 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:02.089430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f1018e4a-34b0-4ac4-996d-e46e6bb79245 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1209 microversion: 2.1 time: 0.090087 Sep 03 01:35:02.090043 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 171/349] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:01 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:02.812989 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8a5dea7e-57f5-4ddf-a30e-0172b3775945 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Action: 'create', calling method: .version_select at 0x7f6d24b07e50>, body: {"keypair": {"name": "tempest-keypair-1583236965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMVNx0ia8raX35zV/Jf2bq/OSkizBBtqkm1EDD3ozDz+8T7hguO3PUMrjO/cYTNdWS0/NVU7B3+Mq1CbKwck/IGNCFmNAJOUFEdNZUJ70re2tS4Z9PGcWzMaTEnW/FcIaQ=="}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:02.830473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-8a5dea7e-57f5-4ddf-a30e-0172b3775945 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Getting quotas for project d93c5a3ef20c4a5b87af4803f820b60e. Resources: {'key_pairs'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:35:02.835562 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-8a5dea7e-57f5-4ddf-a30e-0172b3775945 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Getting quotas for user 409c324dca974d9dad9529b2a0d82b30 and project d93c5a3ef20c4a5b87af4803f820b60e. Resources: {'key_pairs'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:35:02.951639 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-8a5dea7e-57f5-4ddf-a30e-0172b3775945 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.142344 Sep 03 01:35:02.952550 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 179/350] 10.222.0.13 () {60 vars in 1159 bytes} [Sat Sep 3 01:35:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:35:03.112885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-61b396dd-907d-4bb0-94fb-22ac7ae01956 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:03.113601 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-61b396dd-907d-4bb0-94fb-22ac7ae01956 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:03.121159 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-61b396dd-907d-4bb0-94fb-22ac7ae01956 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:03.121944 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-61b396dd-907d-4bb0-94fb-22ac7ae01956 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:03.122514 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-61b396dd-907d-4bb0-94fb-22ac7ae01956 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:03.123319 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-61b396dd-907d-4bb0-94fb-22ac7ae01956 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:03.123868 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-61b396dd-907d-4bb0-94fb-22ac7ae01956 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:03.124566 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-61b396dd-907d-4bb0-94fb-22ac7ae01956 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:03.204539 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-61b396dd-907d-4bb0-94fb-22ac7ae01956 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:03.223261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-61b396dd-907d-4bb0-94fb-22ac7ae01956 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1265 microversion: 2.1 time: 0.114729 Sep 03 01:35:03.223841 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 172/351] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:03 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:04.247251 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f9ab72f8-8b2d-4f80-ab61-5853f9c73a0f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:04.247935 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f9ab72f8-8b2d-4f80-ab61-5853f9c73a0f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:04.254968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9ab72f8-8b2d-4f80-ab61-5853f9c73a0f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:04.256375 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9ab72f8-8b2d-4f80-ab61-5853f9c73a0f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:04.257071 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9ab72f8-8b2d-4f80-ab61-5853f9c73a0f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:04.258013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9ab72f8-8b2d-4f80-ab61-5853f9c73a0f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:04.258597 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9ab72f8-8b2d-4f80-ab61-5853f9c73a0f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:04.259252 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9ab72f8-8b2d-4f80-ab61-5853f9c73a0f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:04.638736 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f9ab72f8-8b2d-4f80-ab61-5853f9c73a0f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:04.648552 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f9ab72f8-8b2d-4f80-ab61-5853f9c73a0f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1271 microversion: 2.1 time: 0.406122 Sep 03 01:35:04.649049 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 180/352] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:04 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1271 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:05.673644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4a6ee323-23fe-4281-b150-ac3f6c950743 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:05.674252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4a6ee323-23fe-4281-b150-ac3f6c950743 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:05.681189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a6ee323-23fe-4281-b150-ac3f6c950743 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:05.681878 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a6ee323-23fe-4281-b150-ac3f6c950743 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:05.682661 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a6ee323-23fe-4281-b150-ac3f6c950743 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:05.683349 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a6ee323-23fe-4281-b150-ac3f6c950743 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:05.683953 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a6ee323-23fe-4281-b150-ac3f6c950743 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:05.684372 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a6ee323-23fe-4281-b150-ac3f6c950743 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:05.959305 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4a6ee323-23fe-4281-b150-ac3f6c950743 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:05.967673 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4a6ee323-23fe-4281-b150-ac3f6c950743 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1313 microversion: 2.1 time: 0.298177 Sep 03 01:35:05.968809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 173/353] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:05 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1313 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:06.138909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-2a961654-334d-484d-9d4a-7fe6a5f1adfc req-56550a1c-2441-48ed-b0e3-5ff347a0ec64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "981601c6-5b5e-494b-b553-c785dd79ceb6", "tag": "a2d2b55e-0e55-466f-99f4-6e63ae698e3b"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:06.149044 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-2a961654-334d-484d-9d4a-7fe6a5f1adfc req-56550a1c-2441-48ed-b0e3-5ff347a0ec64 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:06.149517 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-2a961654-334d-484d-9d4a-7fe6a5f1adfc req-56550a1c-2441-48ed-b0e3-5ff347a0ec64 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:06.149948 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-2a961654-334d-484d-9d4a-7fe6a5f1adfc req-56550a1c-2441-48ed-b0e3-5ff347a0ec64 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:06.331359 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-2a961654-334d-484d-9d4a-7fe6a5f1adfc req-56550a1c-2441-48ed-b0e3-5ff347a0ec64 service nova] Creating event network-changed:a2d2b55e-0e55-466f-99f4-6e63ae698e3b for instance 981601c6-5b5e-494b-b553-c785dd79ceb6 on hv-cinder-83800 Sep 03 01:35:06.337495 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-2a961654-334d-484d-9d4a-7fe6a5f1adfc req-56550a1c-2441-48ed-b0e3-5ff347a0ec64 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202065 Sep 03 01:35:06.338160 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 181/354] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:35:06.927478 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2057166751", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "df7b7060-2be9-45b6-8d4b-e4a77085b457"}], "security_groups": [{"name": "tempest-securitygroup--1098698355"}], "key_name": "tempest-keypair-1583236965", "user_data": "}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:06.992278 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-338109bf-6959-4834-b687-d9ab21bc7ac0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:06.993172 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-338109bf-6959-4834-b687-d9ab21bc7ac0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:07.000075 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-338109bf-6959-4834-b687-d9ab21bc7ac0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:07.000573 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-338109bf-6959-4834-b687-d9ab21bc7ac0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:07.002715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-338109bf-6959-4834-b687-d9ab21bc7ac0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:07.002715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-338109bf-6959-4834-b687-d9ab21bc7ac0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:07.002715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-338109bf-6959-4834-b687-d9ab21bc7ac0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:07.002715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-338109bf-6959-4834-b687-d9ab21bc7ac0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:07.055823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.network.neutron [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] validate_networks() for [('df7b7060-2be9-45b6-8d4b-e4a77085b457', None, None, None, None, None)] {{(pid=127553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:35:07.160643 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-338109bf-6959-4834-b687-d9ab21bc7ac0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:07.172486 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-338109bf-6959-4834-b687-d9ab21bc7ac0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1313 microversion: 2.1 time: 0.185358 Sep 03 01:35:07.183248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 182/355] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:06 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:35:07.487762 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Flavor limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:35:07.488195 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Image limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:35:07.488668 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Flavor pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:35:07.489077 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Image pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:35:07.489487 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:35:07.498644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:07.499099 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:07.499531 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:07.500411 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:07.500861 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:07.501280 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:07.519489 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Getting quotas for project d93c5a3ef20c4a5b87af4803f820b60e. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:35:07.524174 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Getting quotas for user 409c324dca974d9dad9529b2a0d82b30 and project d93c5a3ef20c4a5b87af4803f820b60e. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:35:07.535450 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Going to run 1 instances... {{(pid=127553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:35:07.538014 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:35:07.868328 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-50dd9afb-ece5-4875-af25-3c72953f2473 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.945196 Sep 03 01:35:07.869058 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 174/356] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:35:06 2022] POST /compute/v2.1/servers => generated 409 bytes in 947 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:35:07.881933 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-37237b33-488a-4099-88a9-3d09e10099d0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:07.882769 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-37237b33-488a-4099-88a9-3d09e10099d0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:07.886034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:07.962254 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-37237b33-488a-4099-88a9-3d09e10099d0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:07.970041 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-37237b33-488a-4099-88a9-3d09e10099d0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1246 microversion: 2.1 time: 0.093107 Sep 03 01:35:07.970633 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 183/357] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:07 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:08.205515 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a4e86ef2-ed4e-4cc8-bfd1-fbdea69c68f0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:08.206118 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a4e86ef2-ed4e-4cc8-bfd1-fbdea69c68f0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:08.225114 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a4e86ef2-ed4e-4cc8-bfd1-fbdea69c68f0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:08.225668 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a4e86ef2-ed4e-4cc8-bfd1-fbdea69c68f0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:08.232308 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a4e86ef2-ed4e-4cc8-bfd1-fbdea69c68f0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:08.233163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a4e86ef2-ed4e-4cc8-bfd1-fbdea69c68f0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:08.234373 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a4e86ef2-ed4e-4cc8-bfd1-fbdea69c68f0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:08.234839 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a4e86ef2-ed4e-4cc8-bfd1-fbdea69c68f0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:08.419979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a4e86ef2-ed4e-4cc8-bfd1-fbdea69c68f0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:08.430086 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a4e86ef2-ed4e-4cc8-bfd1-fbdea69c68f0 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1313 microversion: 2.1 time: 0.229303 Sep 03 01:35:08.450583 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 175/358] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:08 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:08.997858 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2caae96b-92f2-4664-a795-1d0fa8ae8d2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:08.999221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2caae96b-92f2-4664-a795-1d0fa8ae8d2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:09.001139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=4 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:09.006111 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2caae96b-92f2-4664-a795-1d0fa8ae8d2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:09.006640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2caae96b-92f2-4664-a795-1d0fa8ae8d2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:09.007082 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2caae96b-92f2-4664-a795-1d0fa8ae8d2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:09.007790 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2caae96b-92f2-4664-a795-1d0fa8ae8d2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:09.008247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2caae96b-92f2-4664-a795-1d0fa8ae8d2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:09.008700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2caae96b-92f2-4664-a795-1d0fa8ae8d2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:09.072800 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2caae96b-92f2-4664-a795-1d0fa8ae8d2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:09.080474 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2caae96b-92f2-4664-a795-1d0fa8ae8d2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1250 microversion: 2.1 time: 0.088030 Sep 03 01:35:09.081034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 184/359] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:08 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1250 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:09.454222 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f76ea60f-b63c-41ee-9dea-c9609c8aa534 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:09.454961 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f76ea60f-b63c-41ee-9dea-c9609c8aa534 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:09.461996 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f76ea60f-b63c-41ee-9dea-c9609c8aa534 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:09.462602 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f76ea60f-b63c-41ee-9dea-c9609c8aa534 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:09.464191 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f76ea60f-b63c-41ee-9dea-c9609c8aa534 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:09.464191 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f76ea60f-b63c-41ee-9dea-c9609c8aa534 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:09.464632 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f76ea60f-b63c-41ee-9dea-c9609c8aa534 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:09.465054 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f76ea60f-b63c-41ee-9dea-c9609c8aa534 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:09.607951 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-f76ea60f-b63c-41ee-9dea-c9609c8aa534 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:09.616127 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f76ea60f-b63c-41ee-9dea-c9609c8aa534 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1313 microversion: 2.1 time: 0.166218 Sep 03 01:35:09.616899 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 176/360] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:09 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:10.103629 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-1ac7a72f-5684-44e3-bb7c-1521d104716a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:10.104865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-1ac7a72f-5684-44e3-bb7c-1521d104716a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:10.112186 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1ac7a72f-5684-44e3-bb7c-1521d104716a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:10.112678 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1ac7a72f-5684-44e3-bb7c-1521d104716a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:10.118113 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1ac7a72f-5684-44e3-bb7c-1521d104716a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:10.118113 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1ac7a72f-5684-44e3-bb7c-1521d104716a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:10.118113 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1ac7a72f-5684-44e3-bb7c-1521d104716a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:10.118113 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1ac7a72f-5684-44e3-bb7c-1521d104716a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:10.178639 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1ac7a72f-5684-44e3-bb7c-1521d104716a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:10.186671 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-1ac7a72f-5684-44e3-bb7c-1521d104716a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1298 microversion: 2.1 time: 0.087492 Sep 03 01:35:10.187235 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 185/361] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:10 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1298 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:10.640064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ddb57a99-700e-4e0a-9729-568725da0361 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:10.640896 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ddb57a99-700e-4e0a-9729-568725da0361 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:10.648208 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ddb57a99-700e-4e0a-9729-568725da0361 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:10.654961 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ddb57a99-700e-4e0a-9729-568725da0361 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:10.654961 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ddb57a99-700e-4e0a-9729-568725da0361 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:10.654961 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ddb57a99-700e-4e0a-9729-568725da0361 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:10.654961 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ddb57a99-700e-4e0a-9729-568725da0361 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:10.655319 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ddb57a99-700e-4e0a-9729-568725da0361 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:10.850681 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ddb57a99-700e-4e0a-9729-568725da0361 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:10.860302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ddb57a99-700e-4e0a-9729-568725da0361 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1313 microversion: 2.1 time: 0.224003 Sep 03 01:35:10.865595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 177/362] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:10 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1313 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:11.210980 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f0565132-042d-4973-9f0c-f4e9691cde1a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:11.211586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f0565132-042d-4973-9f0c-f4e9691cde1a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:11.217818 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f0565132-042d-4973-9f0c-f4e9691cde1a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:11.218304 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f0565132-042d-4973-9f0c-f4e9691cde1a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:11.218763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f0565132-042d-4973-9f0c-f4e9691cde1a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:11.219452 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f0565132-042d-4973-9f0c-f4e9691cde1a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:11.219903 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f0565132-042d-4973-9f0c-f4e9691cde1a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:11.220329 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f0565132-042d-4973-9f0c-f4e9691cde1a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:11.283375 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f0565132-042d-4973-9f0c-f4e9691cde1a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:11.290866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f0565132-042d-4973-9f0c-f4e9691cde1a tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1304 microversion: 2.1 time: 0.084469 Sep 03 01:35:11.295572 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 186/363] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:11 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1304 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:11.891422 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-129e0014-a4fa-4fe0-afb6-ea5db3aaca80 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:11.893489 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-129e0014-a4fa-4fe0-afb6-ea5db3aaca80 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:11.905392 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-129e0014-a4fa-4fe0-afb6-ea5db3aaca80 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:11.908011 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-129e0014-a4fa-4fe0-afb6-ea5db3aaca80 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:11.908891 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-129e0014-a4fa-4fe0-afb6-ea5db3aaca80 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:11.911715 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-129e0014-a4fa-4fe0-afb6-ea5db3aaca80 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:11.912398 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-129e0014-a4fa-4fe0-afb6-ea5db3aaca80 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:11.913027 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-129e0014-a4fa-4fe0-afb6-ea5db3aaca80 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:11.939626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:12.123446 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-129e0014-a4fa-4fe0-afb6-ea5db3aaca80 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:12.133590 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-129e0014-a4fa-4fe0-afb6-ea5db3aaca80 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1313 microversion: 2.1 time: 0.249444 Sep 03 01:35:12.134496 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 178/364] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:11 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1313 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:12.313968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9a8ba568-70fc-4d10-ac5b-65c4d72c7da0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:12.314629 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9a8ba568-70fc-4d10-ac5b-65c4d72c7da0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:12.320911 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a8ba568-70fc-4d10-ac5b-65c4d72c7da0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:12.321399 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a8ba568-70fc-4d10-ac5b-65c4d72c7da0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:12.321834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a8ba568-70fc-4d10-ac5b-65c4d72c7da0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:12.322575 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a8ba568-70fc-4d10-ac5b-65c4d72c7da0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:12.323046 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a8ba568-70fc-4d10-ac5b-65c4d72c7da0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:12.323461 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a8ba568-70fc-4d10-ac5b-65c4d72c7da0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:12.414397 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-3b5a3b0c-d638-4d6a-bed5-f4472b1c6b66 req-e9a80826-ca7e-4a29-80a6-2ce6c9dc29c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34abe46a-5361-4e96-a952-5909fad8c4f4", "tag": "885d8df4-2f3f-463e-aa94-cb8b3ae9cb29"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:12.424951 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-3b5a3b0c-d638-4d6a-bed5-f4472b1c6b66 req-e9a80826-ca7e-4a29-80a6-2ce6c9dc29c4 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:12.425428 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-3b5a3b0c-d638-4d6a-bed5-f4472b1c6b66 req-e9a80826-ca7e-4a29-80a6-2ce6c9dc29c4 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:12.425857 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-3b5a3b0c-d638-4d6a-bed5-f4472b1c6b66 req-e9a80826-ca7e-4a29-80a6-2ce6c9dc29c4 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:12.436993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-3b5a3b0c-d638-4d6a-bed5-f4472b1c6b66 req-e9a80826-ca7e-4a29-80a6-2ce6c9dc29c4 service nova] Creating event network-changed:885d8df4-2f3f-463e-aa94-cb8b3ae9cb29 for instance 34abe46a-5361-4e96-a952-5909fad8c4f4 on hv-cinder-83800 Sep 03 01:35:12.442417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-3b5a3b0c-d638-4d6a-bed5-f4472b1c6b66 req-e9a80826-ca7e-4a29-80a6-2ce6c9dc29c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032271 Sep 03 01:35:12.443806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 179/365] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:35:12.493803 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4a8332a2-b9f5-43c0-ade0-c2cd200b7852 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:12.494436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4a8332a2-b9f5-43c0-ade0-c2cd200b7852 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:12.500899 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a8332a2-b9f5-43c0-ade0-c2cd200b7852 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:12.501389 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a8332a2-b9f5-43c0-ade0-c2cd200b7852 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:12.501833 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a8332a2-b9f5-43c0-ade0-c2cd200b7852 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:12.502557 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a8332a2-b9f5-43c0-ade0-c2cd200b7852 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:12.503023 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a8332a2-b9f5-43c0-ade0-c2cd200b7852 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:12.503446 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a8332a2-b9f5-43c0-ade0-c2cd200b7852 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:12.528073 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4a8332a2-b9f5-43c0-ade0-c2cd200b7852 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/ips" status: 200 len: 152 microversion: 2.20 time: 0.039478 Sep 03 01:35:12.528798 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 180/366] 10.222.0.13 () {60 vars in 1289 bytes} [Sat Sep 3 01:35:12 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 01:35:12.552389 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9a8ba568-70fc-4d10-ac5b-65c4d72c7da0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:12.559914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9a8ba568-70fc-4d10-ac5b-65c4d72c7da0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1372 microversion: 2.1 time: 0.249865 Sep 03 01:35:12.560487 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 187/367] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:12 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1372 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:13.158096 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5800f93f-6d47-4f51-8e3d-5baeccef490f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:13.158487 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5800f93f-6d47-4f51-8e3d-5baeccef490f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:13.165938 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5800f93f-6d47-4f51-8e3d-5baeccef490f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:13.166707 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5800f93f-6d47-4f51-8e3d-5baeccef490f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:13.167332 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5800f93f-6d47-4f51-8e3d-5baeccef490f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:13.168210 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5800f93f-6d47-4f51-8e3d-5baeccef490f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:13.168847 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5800f93f-6d47-4f51-8e3d-5baeccef490f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:13.169784 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5800f93f-6d47-4f51-8e3d-5baeccef490f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:13.314560 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5800f93f-6d47-4f51-8e3d-5baeccef490f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:13.323688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5800f93f-6d47-4f51-8e3d-5baeccef490f tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1313 microversion: 2.1 time: 0.170476 Sep 03 01:35:13.324732 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 181/368] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:13 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:35:13.392843 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-05f2b014-61a2-4da4-a62b-75973e7d76e8 req-5c986473-c82e-41cd-9a4a-46351313ae99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981601c6-5b5e-494b-b553-c785dd79ceb6", "name": "network-vif-plugged", "status": "completed", "tag": "a2d2b55e-0e55-466f-99f4-6e63ae698e3b"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:13.393304 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9c28650f-961b-4459-bf1a-eb117b3b18e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:13.393840 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9c28650f-961b-4459-bf1a-eb117b3b18e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:13.404116 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-05f2b014-61a2-4da4-a62b-75973e7d76e8 req-5c986473-c82e-41cd-9a4a-46351313ae99 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:13.404595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-05f2b014-61a2-4da4-a62b-75973e7d76e8 req-5c986473-c82e-41cd-9a4a-46351313ae99 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:13.405037 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-05f2b014-61a2-4da4-a62b-75973e7d76e8 req-5c986473-c82e-41cd-9a4a-46351313ae99 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:13.406619 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9c28650f-961b-4459-bf1a-eb117b3b18e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:13.407131 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9c28650f-961b-4459-bf1a-eb117b3b18e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:13.407588 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9c28650f-961b-4459-bf1a-eb117b3b18e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:13.408305 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9c28650f-961b-4459-bf1a-eb117b3b18e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:13.408776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9c28650f-961b-4459-bf1a-eb117b3b18e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:13.415207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9c28650f-961b-4459-bf1a-eb117b3b18e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:13.417853 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-05f2b014-61a2-4da4-a62b-75973e7d76e8 req-5c986473-c82e-41cd-9a4a-46351313ae99 service nova] Creating event network-vif-plugged:a2d2b55e-0e55-466f-99f4-6e63ae698e3b for instance 981601c6-5b5e-494b-b553-c785dd79ceb6 on hv-cinder-83800 Sep 03 01:35:13.423220 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-05f2b014-61a2-4da4-a62b-75973e7d76e8 req-5c986473-c82e-41cd-9a4a-46351313ae99 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040421 Sep 03 01:35:13.424298 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 182/369] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:35:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:35:13.446094 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9c28650f-961b-4459-bf1a-eb117b3b18e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/ips" status: 200 len: 149 microversion: 2.1 time: 0.068319 Sep 03 01:35:13.446743 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 188/370] 10.222.0.13 () {58 vars in 1248 bytes} [Sat Sep 3 01:35:13 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/ips => generated 149 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:35:13.588998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8a0be259-b0dc-417d-a4ae-fc572cb1238c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:13.589942 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8a0be259-b0dc-417d-a4ae-fc572cb1238c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:13.596418 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a0be259-b0dc-417d-a4ae-fc572cb1238c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:13.605018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a0be259-b0dc-417d-a4ae-fc572cb1238c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:13.605018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a0be259-b0dc-417d-a4ae-fc572cb1238c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:13.605018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a0be259-b0dc-417d-a4ae-fc572cb1238c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:13.605018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a0be259-b0dc-417d-a4ae-fc572cb1238c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:13.605523 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a0be259-b0dc-417d-a4ae-fc572cb1238c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:13.767463 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8a0be259-b0dc-417d-a4ae-fc572cb1238c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:13.775437 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8a0be259-b0dc-417d-a4ae-fc572cb1238c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1372 microversion: 2.1 time: 0.196291 Sep 03 01:35:13.776004 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 183/371] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:13 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1372 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:14.347318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0985e691-7c05-42a5-867f-330103a60fee tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:14.347959 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0985e691-7c05-42a5-867f-330103a60fee tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:14.354179 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0985e691-7c05-42a5-867f-330103a60fee tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:14.354704 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0985e691-7c05-42a5-867f-330103a60fee tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:14.355142 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0985e691-7c05-42a5-867f-330103a60fee tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:14.355832 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0985e691-7c05-42a5-867f-330103a60fee tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:14.356285 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0985e691-7c05-42a5-867f-330103a60fee tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:14.356714 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0985e691-7c05-42a5-867f-330103a60fee tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:14.507803 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0985e691-7c05-42a5-867f-330103a60fee tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:14.525791 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0985e691-7c05-42a5-867f-330103a60fee tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1313 microversion: 2.1 time: 0.181828 Sep 03 01:35:14.543760 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 189/372] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:14 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1313 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:14.800023 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9e34567c-ef6d-4ad2-ac95-957783f28d54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:14.802157 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9e34567c-ef6d-4ad2-ac95-957783f28d54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:14.814249 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e34567c-ef6d-4ad2-ac95-957783f28d54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:14.815239 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e34567c-ef6d-4ad2-ac95-957783f28d54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:14.816059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e34567c-ef6d-4ad2-ac95-957783f28d54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:14.817059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e34567c-ef6d-4ad2-ac95-957783f28d54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:14.817758 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e34567c-ef6d-4ad2-ac95-957783f28d54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:14.818384 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e34567c-ef6d-4ad2-ac95-957783f28d54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:14.993979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9e34567c-ef6d-4ad2-ac95-957783f28d54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:15.002826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9e34567c-ef6d-4ad2-ac95-957783f28d54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1372 microversion: 2.1 time: 0.208115 Sep 03 01:35:15.004739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 184/373] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:14 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:35:15.552461 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cd1ae171-03d6-4cbb-afe9-59c3e84b8564 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:15.553240 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cd1ae171-03d6-4cbb-afe9-59c3e84b8564 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:15.568598 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd1ae171-03d6-4cbb-afe9-59c3e84b8564 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:15.568598 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd1ae171-03d6-4cbb-afe9-59c3e84b8564 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:15.569039 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd1ae171-03d6-4cbb-afe9-59c3e84b8564 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:15.569868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd1ae171-03d6-4cbb-afe9-59c3e84b8564 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:15.570213 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd1ae171-03d6-4cbb-afe9-59c3e84b8564 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:15.570662 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd1ae171-03d6-4cbb-afe9-59c3e84b8564 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:15.697797 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-225b1fa8-a207-47ab-b584-0554ccc089d4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac82605a-b9eb-4d6d-8095-6d66e17c59c2"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:15.700338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-225b1fa8-a207-47ab-b584-0554ccc089d4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:15.706847 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-225b1fa8-a207-47ab-b584-0554ccc089d4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:15.707756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-225b1fa8-a207-47ab-b584-0554ccc089d4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:15.709967 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-225b1fa8-a207-47ab-b584-0554ccc089d4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:15.710998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-225b1fa8-a207-47ab-b584-0554ccc089d4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:15.711847 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-225b1fa8-a207-47ab-b584-0554ccc089d4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:15.713177 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-225b1fa8-a207-47ab-b584-0554ccc089d4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:15.742758 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cd1ae171-03d6-4cbb-afe9-59c3e84b8564 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:15.773670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cd1ae171-03d6-4cbb-afe9-59c3e84b8564 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1313 microversion: 2.1 time: 0.217623 Sep 03 01:35:15.773670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 190/374] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:15 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:15.888806 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-00c081fe-4f62-4c45-ba3d-f785fa8fe75c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:15.889549 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-00c081fe-4f62-4c45-ba3d-f785fa8fe75c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:15.898460 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00c081fe-4f62-4c45-ba3d-f785fa8fe75c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:15.907228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00c081fe-4f62-4c45-ba3d-f785fa8fe75c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:15.907228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00c081fe-4f62-4c45-ba3d-f785fa8fe75c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:15.907228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00c081fe-4f62-4c45-ba3d-f785fa8fe75c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:15.907228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00c081fe-4f62-4c45-ba3d-f785fa8fe75c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:15.907614 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00c081fe-4f62-4c45-ba3d-f785fa8fe75c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:15.925901 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-00c081fe-4f62-4c45-ba3d-f785fa8fe75c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lazy-loading 'flavor' on Instance uuid 329ea656-c337-4f07-bd3d-9f67c4d6418e {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:35:16.545811 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-00c081fe-4f62-4c45-ba3d-f785fa8fe75c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "POST /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/action" status: 202 len: 0 microversion: 2.20 time: 0.663733 Sep 03 01:35:16.550783 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 191/375] 10.222.0.13 () {62 vars in 1319 bytes} [Sat Sep 3 01:35:15 2022] POST /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/action => generated 0 bytes in 670 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:35:16.558029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f5337abd-25f9-4cd2-bfc0-5d7450139d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:16.561926 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f5337abd-25f9-4cd2-bfc0-5d7450139d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:16.570829 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f5337abd-25f9-4cd2-bfc0-5d7450139d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:16.571516 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f5337abd-25f9-4cd2-bfc0-5d7450139d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:16.572299 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f5337abd-25f9-4cd2-bfc0-5d7450139d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:16.573401 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f5337abd-25f9-4cd2-bfc0-5d7450139d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:16.573856 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f5337abd-25f9-4cd2-bfc0-5d7450139d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:16.574452 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f5337abd-25f9-4cd2-bfc0-5d7450139d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:16.740058 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f5337abd-25f9-4cd2-bfc0-5d7450139d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:16.750749 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f5337abd-25f9-4cd2-bfc0-5d7450139d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1372 microversion: 2.1 time: 0.198205 Sep 03 01:35:16.751607 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 192/376] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:16 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:16.757142 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3c5078d5-1dfe-40bb-b723-7020ec01418f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:16.757990 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-3c5078d5-1dfe-40bb-b723-7020ec01418f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:16.765540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3c5078d5-1dfe-40bb-b723-7020ec01418f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:16.766445 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3c5078d5-1dfe-40bb-b723-7020ec01418f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:16.767051 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3c5078d5-1dfe-40bb-b723-7020ec01418f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:16.768246 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3c5078d5-1dfe-40bb-b723-7020ec01418f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:16.768772 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3c5078d5-1dfe-40bb-b723-7020ec01418f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:16.769377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3c5078d5-1dfe-40bb-b723-7020ec01418f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:16.836207 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-225b1fa8-a207-47ab-b584-0554ccc089d4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "POST /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.142084 Sep 03 01:35:16.837446 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 185/377] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:35:15 2022] POST /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments => generated 194 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:35:16.843434 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-489b5881-ceba-442f-a22c-761d09ef53e9 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:16.857499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-489b5881-ceba-442f-a22c-761d09ef53e9 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:16.868421 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-489b5881-ceba-442f-a22c-761d09ef53e9 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:16.869559 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-489b5881-ceba-442f-a22c-761d09ef53e9 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:16.870327 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-489b5881-ceba-442f-a22c-761d09ef53e9 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:16.871467 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-489b5881-ceba-442f-a22c-761d09ef53e9 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:16.872485 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-489b5881-ceba-442f-a22c-761d09ef53e9 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:16.873079 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-489b5881-ceba-442f-a22c-761d09ef53e9 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:16.970256 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3c5078d5-1dfe-40bb-b723-7020ec01418f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:16.980825 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3c5078d5-1dfe-40bb-b723-7020ec01418f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:16.982775 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3c5078d5-1dfe-40bb-b723-7020ec01418f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:16.984497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3c5078d5-1dfe-40bb-b723-7020ec01418f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.231806 Sep 03 01:35:16.985495 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 193/378] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:16 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:17.103500 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-489b5881-ceba-442f-a22c-761d09ef53e9 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:17.121706 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-489b5881-ceba-442f-a22c-761d09ef53e9 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1313 microversion: 2.1 time: 0.282603 Sep 03 01:35:17.122652 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 186/379] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:16 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:17.270230 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e55d081c-5531-4d13-9456-15528eb2ffad tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:17.270839 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e55d081c-5531-4d13-9456-15528eb2ffad tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:17.282378 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e55d081c-5531-4d13-9456-15528eb2ffad tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:17.282902 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e55d081c-5531-4d13-9456-15528eb2ffad tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:17.283355 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e55d081c-5531-4d13-9456-15528eb2ffad tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:17.284083 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e55d081c-5531-4d13-9456-15528eb2ffad tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:17.284558 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e55d081c-5531-4d13-9456-15528eb2ffad tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:17.284979 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e55d081c-5531-4d13-9456-15528eb2ffad tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:17.356410 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e55d081c-5531-4d13-9456-15528eb2ffad tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/ips" status: 200 len: 147 microversion: 2.1 time: 0.090819 Sep 03 01:35:17.360247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 194/380] 10.222.0.13 () {58 vars in 1248 bytes} [Sat Sep 3 01:35:17 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/ips => generated 147 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:35:17.774657 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7edcd95c-cc9c-44d3-bdce-fc1c36d2fef6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:17.775524 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7edcd95c-cc9c-44d3-bdce-fc1c36d2fef6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:17.779776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:17.780465 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=6 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:17.785060 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7edcd95c-cc9c-44d3-bdce-fc1c36d2fef6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:17.785655 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7edcd95c-cc9c-44d3-bdce-fc1c36d2fef6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:17.786387 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7edcd95c-cc9c-44d3-bdce-fc1c36d2fef6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:17.787405 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7edcd95c-cc9c-44d3-bdce-fc1c36d2fef6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:17.788090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7edcd95c-cc9c-44d3-bdce-fc1c36d2fef6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:17.788610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7edcd95c-cc9c-44d3-bdce-fc1c36d2fef6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:17.959188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7edcd95c-cc9c-44d3-bdce-fc1c36d2fef6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:17.966887 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7edcd95c-cc9c-44d3-bdce-fc1c36d2fef6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1372 microversion: 2.1 time: 0.196883 Sep 03 01:35:17.967461 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 187/381] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:17 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1372 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:18.026602 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-deff3cc6-2fc7-4ecd-a34f-0ef02e9c6808 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:18.027782 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-deff3cc6-2fc7-4ecd-a34f-0ef02e9c6808 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:18.029907 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=14 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:18.034935 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-deff3cc6-2fc7-4ecd-a34f-0ef02e9c6808 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:18.035412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-deff3cc6-2fc7-4ecd-a34f-0ef02e9c6808 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:18.035893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-deff3cc6-2fc7-4ecd-a34f-0ef02e9c6808 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:18.037255 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-deff3cc6-2fc7-4ecd-a34f-0ef02e9c6808 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:18.037715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-deff3cc6-2fc7-4ecd-a34f-0ef02e9c6808 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:18.038330 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-deff3cc6-2fc7-4ecd-a34f-0ef02e9c6808 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:18.153100 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4a76310e-9177-4ac0-b791-96a16212dcd1 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:18.153646 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4a76310e-9177-4ac0-b791-96a16212dcd1 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:18.160029 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a76310e-9177-4ac0-b791-96a16212dcd1 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:18.160593 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a76310e-9177-4ac0-b791-96a16212dcd1 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:18.161101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a76310e-9177-4ac0-b791-96a16212dcd1 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:18.162563 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a76310e-9177-4ac0-b791-96a16212dcd1 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:18.163087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a76310e-9177-4ac0-b791-96a16212dcd1 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:18.163730 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a76310e-9177-4ac0-b791-96a16212dcd1 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:18.185118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-deff3cc6-2fc7-4ecd-a34f-0ef02e9c6808 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:18.195238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:18.205971 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-deff3cc6-2fc7-4ecd-a34f-0ef02e9c6808 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:18.208903 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-deff3cc6-2fc7-4ecd-a34f-0ef02e9c6808 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:18.210753 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-deff3cc6-2fc7-4ecd-a34f-0ef02e9c6808 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.187916 Sep 03 01:35:18.212396 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 195/382] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:18 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:18.326600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4a76310e-9177-4ac0-b791-96a16212dcd1 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:18.334772 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4a76310e-9177-4ac0-b791-96a16212dcd1 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1497 microversion: 2.1 time: 0.185458 Sep 03 01:35:18.335490 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 188/383] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:18 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:35:18.991053 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-1dbde45a-fd29-4947-833c-28e4222a70ba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:18.991700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-1dbde45a-fd29-4947-833c-28e4222a70ba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:18.999201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1dbde45a-fd29-4947-833c-28e4222a70ba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:18.999684 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1dbde45a-fd29-4947-833c-28e4222a70ba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:19.000117 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1dbde45a-fd29-4947-833c-28e4222a70ba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:19.000803 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1dbde45a-fd29-4947-833c-28e4222a70ba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:19.004100 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1dbde45a-fd29-4947-833c-28e4222a70ba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:19.004100 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1dbde45a-fd29-4947-833c-28e4222a70ba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:19.242549 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-79d7e9db-fdf6-44eb-b7f0-923aab3e1db5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:19.243261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-79d7e9db-fdf6-44eb-b7f0-923aab3e1db5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:19.249782 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-79d7e9db-fdf6-44eb-b7f0-923aab3e1db5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:19.250294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-79d7e9db-fdf6-44eb-b7f0-923aab3e1db5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:19.250837 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-79d7e9db-fdf6-44eb-b7f0-923aab3e1db5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:19.252902 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-79d7e9db-fdf6-44eb-b7f0-923aab3e1db5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:19.253368 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-79d7e9db-fdf6-44eb-b7f0-923aab3e1db5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:19.253802 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-79d7e9db-fdf6-44eb-b7f0-923aab3e1db5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:19.537082 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1dbde45a-fd29-4947-833c-28e4222a70ba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:19.564590 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-1dbde45a-fd29-4947-833c-28e4222a70ba tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1372 microversion: 2.1 time: 0.576970 Sep 03 01:35:19.568575 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 196/384] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:18 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1372 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:19.577178 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-a2d9e780-9849-42ee-a25b-402a4619c135 req-ff5ad9d6-6b05-4a70-b51c-58dbbef20434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34abe46a-5361-4e96-a952-5909fad8c4f4", "name": "network-vif-plugged", "status": "completed", "tag": "885d8df4-2f3f-463e-aa94-cb8b3ae9cb29"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:19.586694 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-79d7e9db-fdf6-44eb-b7f0-923aab3e1db5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:19.594592 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a2d9e780-9849-42ee-a25b-402a4619c135 req-ff5ad9d6-6b05-4a70-b51c-58dbbef20434 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:19.595336 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a2d9e780-9849-42ee-a25b-402a4619c135 req-ff5ad9d6-6b05-4a70-b51c-58dbbef20434 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:19.595915 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a2d9e780-9849-42ee-a25b-402a4619c135 req-ff5ad9d6-6b05-4a70-b51c-58dbbef20434 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:19.602764 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-79d7e9db-fdf6-44eb-b7f0-923aab3e1db5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:19.606040 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-79d7e9db-fdf6-44eb-b7f0-923aab3e1db5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:19.607263 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-79d7e9db-fdf6-44eb-b7f0-923aab3e1db5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.371045 Sep 03 01:35:19.612058 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-a2d9e780-9849-42ee-a25b-402a4619c135 req-ff5ad9d6-6b05-4a70-b51c-58dbbef20434 service nova] Creating event network-vif-plugged:885d8df4-2f3f-463e-aa94-cb8b3ae9cb29 for instance 34abe46a-5361-4e96-a952-5909fad8c4f4 on hv-cinder-83800 Sep 03 01:35:19.612800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 189/385] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:19 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:19.639941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-a2d9e780-9849-42ee-a25b-402a4619c135 req-ff5ad9d6-6b05-4a70-b51c-58dbbef20434 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068836 Sep 03 01:35:19.640670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 197/386] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:35:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:35:20.002959 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7c335c12-d147-4939-955c-eec5150dba51 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:20.003795 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7c335c12-d147-4939-955c-eec5150dba51 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:20.011574 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c335c12-d147-4939-955c-eec5150dba51 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:20.012335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c335c12-d147-4939-955c-eec5150dba51 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:20.012874 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c335c12-d147-4939-955c-eec5150dba51 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:20.019393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c335c12-d147-4939-955c-eec5150dba51 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:20.019393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c335c12-d147-4939-955c-eec5150dba51 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:20.019393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c335c12-d147-4939-955c-eec5150dba51 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:20.044773 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7c335c12-d147-4939-955c-eec5150dba51 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:35:20.389704 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7c335c12-d147-4939-955c-eec5150dba51 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "DELETE /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 204 len: 0 microversion: 2.1 time: 0.390288 Sep 03 01:35:20.390321 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 190/387] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:35:19 2022] DELETE /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 01:35:20.399971 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-51fc5584-0c93-462f-86a3-421639121795 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:20.400558 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-51fc5584-0c93-462f-86a3-421639121795 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:20.415651 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51fc5584-0c93-462f-86a3-421639121795 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:20.416259 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51fc5584-0c93-462f-86a3-421639121795 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:20.416757 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51fc5584-0c93-462f-86a3-421639121795 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:20.417704 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51fc5584-0c93-462f-86a3-421639121795 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:20.418311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51fc5584-0c93-462f-86a3-421639121795 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:20.419066 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51fc5584-0c93-462f-86a3-421639121795 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:20.561255 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-51fc5584-0c93-462f-86a3-421639121795 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:20.569555 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-51fc5584-0c93-462f-86a3-421639121795 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1503 microversion: 2.1 time: 0.174487 Sep 03 01:35:20.570164 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 198/388] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:20 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:20.600055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f94f9363-7937-4580-a5c8-842bc7422752 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:20.601057 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f94f9363-7937-4580-a5c8-842bc7422752 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:20.609061 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f94f9363-7937-4580-a5c8-842bc7422752 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:20.611847 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f94f9363-7937-4580-a5c8-842bc7422752 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:20.611847 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f94f9363-7937-4580-a5c8-842bc7422752 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:20.611847 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f94f9363-7937-4580-a5c8-842bc7422752 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:20.611847 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f94f9363-7937-4580-a5c8-842bc7422752 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:20.612298 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f94f9363-7937-4580-a5c8-842bc7422752 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:20.644035 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ae1ce694-1838-4de8-b3c2-3daf710b83db tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:20.646541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ae1ce694-1838-4de8-b3c2-3daf710b83db tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:20.662466 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae1ce694-1838-4de8-b3c2-3daf710b83db tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:20.665388 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae1ce694-1838-4de8-b3c2-3daf710b83db tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:20.666139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae1ce694-1838-4de8-b3c2-3daf710b83db tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:20.669470 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae1ce694-1838-4de8-b3c2-3daf710b83db tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:20.671827 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae1ce694-1838-4de8-b3c2-3daf710b83db tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:20.673123 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae1ce694-1838-4de8-b3c2-3daf710b83db tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:20.783325 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-f94f9363-7937-4580-a5c8-842bc7422752 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:20.792016 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f94f9363-7937-4580-a5c8-842bc7422752 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1372 microversion: 2.1 time: 0.203040 Sep 03 01:35:20.792599 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 191/389] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:20 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:20.804182 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bf461a8d-5575-486d-bd2f-ca7b0f48e3db tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "619e3b9a-d725-4d11-be0b-f2b54cf8eaeb"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:20.807904 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bf461a8d-5575-486d-bd2f-ca7b0f48e3db tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:20.814705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bf461a8d-5575-486d-bd2f-ca7b0f48e3db tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:20.815456 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bf461a8d-5575-486d-bd2f-ca7b0f48e3db tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:20.815910 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bf461a8d-5575-486d-bd2f-ca7b0f48e3db tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:20.816613 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bf461a8d-5575-486d-bd2f-ca7b0f48e3db tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:20.817074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bf461a8d-5575-486d-bd2f-ca7b0f48e3db tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:20.818112 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bf461a8d-5575-486d-bd2f-ca7b0f48e3db tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:20.848674 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ae1ce694-1838-4de8-b3c2-3daf710b83db tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:20.857520 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ae1ce694-1838-4de8-b3c2-3daf710b83db tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:20.859156 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ae1ce694-1838-4de8-b3c2-3daf710b83db tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:20.860472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ae1ce694-1838-4de8-b3c2-3daf710b83db tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.224363 Sep 03 01:35:20.861415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 199/390] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:20 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:21.596221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d3a95403-8f02-4c7a-9917-7dea17648174 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:21.596852 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d3a95403-8f02-4c7a-9917-7dea17648174 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:21.603105 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d3a95403-8f02-4c7a-9917-7dea17648174 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:21.603590 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d3a95403-8f02-4c7a-9917-7dea17648174 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:21.604028 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d3a95403-8f02-4c7a-9917-7dea17648174 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:21.604716 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d3a95403-8f02-4c7a-9917-7dea17648174 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:21.605165 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d3a95403-8f02-4c7a-9917-7dea17648174 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:21.605590 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d3a95403-8f02-4c7a-9917-7dea17648174 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:21.753320 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d3a95403-8f02-4c7a-9917-7dea17648174 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:21.761740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d3a95403-8f02-4c7a-9917-7dea17648174 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1503 microversion: 2.1 time: 0.169311 Sep 03 01:35:21.762635 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 200/391] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:21 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:35:21.815587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f3469e98-d22a-4432-a226-2eb12345b9e6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:21.816708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f3469e98-d22a-4432-a226-2eb12345b9e6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:21.828394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f3469e98-d22a-4432-a226-2eb12345b9e6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:21.828888 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f3469e98-d22a-4432-a226-2eb12345b9e6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:21.829353 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f3469e98-d22a-4432-a226-2eb12345b9e6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:21.830039 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f3469e98-d22a-4432-a226-2eb12345b9e6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:21.830661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f3469e98-d22a-4432-a226-2eb12345b9e6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:21.831106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f3469e98-d22a-4432-a226-2eb12345b9e6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:21.971033 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f3469e98-d22a-4432-a226-2eb12345b9e6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:21.978851 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f3469e98-d22a-4432-a226-2eb12345b9e6 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1372 microversion: 2.1 time: 0.168647 Sep 03 01:35:21.979452 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 201/392] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:21 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:35:21.984414 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8348f200-a01d-4d8e-abcd-55f78c7f0a54 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:21.985015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-8348f200-a01d-4d8e-abcd-55f78c7f0a54 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:21.992282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8348f200-a01d-4d8e-abcd-55f78c7f0a54 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:21.992693 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8348f200-a01d-4d8e-abcd-55f78c7f0a54 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:21.993131 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8348f200-a01d-4d8e-abcd-55f78c7f0a54 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:21.993866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8348f200-a01d-4d8e-abcd-55f78c7f0a54 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:21.994416 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8348f200-a01d-4d8e-abcd-55f78c7f0a54 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:21.994846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8348f200-a01d-4d8e-abcd-55f78c7f0a54 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:22.139529 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8348f200-a01d-4d8e-abcd-55f78c7f0a54 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:22.147998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8348f200-a01d-4d8e-abcd-55f78c7f0a54 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:22.149441 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8348f200-a01d-4d8e-abcd-55f78c7f0a54 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:22.150638 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-8348f200-a01d-4d8e-abcd-55f78c7f0a54 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.170110 Sep 03 01:35:22.151197 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 202/393] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:21 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:22.785301 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-44b605f7-fb3f-4032-8575-2b79e2d8d80e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:22.785933 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-44b605f7-fb3f-4032-8575-2b79e2d8d80e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:22.800975 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-44b605f7-fb3f-4032-8575-2b79e2d8d80e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:22.802184 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-44b605f7-fb3f-4032-8575-2b79e2d8d80e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:22.802849 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-44b605f7-fb3f-4032-8575-2b79e2d8d80e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:22.808614 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-44b605f7-fb3f-4032-8575-2b79e2d8d80e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:22.808614 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-44b605f7-fb3f-4032-8575-2b79e2d8d80e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:22.808614 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-44b605f7-fb3f-4032-8575-2b79e2d8d80e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:22.953510 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:23.090187 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-44b605f7-fb3f-4032-8575-2b79e2d8d80e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:23.098152 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-44b605f7-fb3f-4032-8575-2b79e2d8d80e tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1503 microversion: 2.1 time: 0.316730 Sep 03 01:35:23.115396 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 203/394] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:22 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1503 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:35:23.115396 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0073b0fc-96d8-45d5-99a5-14e862418595 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:23.115396 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0073b0fc-96d8-45d5-99a5-14e862418595 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:23.119122 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0073b0fc-96d8-45d5-99a5-14e862418595 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:23.119621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0073b0fc-96d8-45d5-99a5-14e862418595 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:23.120059 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0073b0fc-96d8-45d5-99a5-14e862418595 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:23.120762 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0073b0fc-96d8-45d5-99a5-14e862418595 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:23.121211 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0073b0fc-96d8-45d5-99a5-14e862418595 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:23.121634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0073b0fc-96d8-45d5-99a5-14e862418595 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:23.162549 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bf461a8d-5575-486d-bd2f-ca7b0f48e3db tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "POST /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.368354 Sep 03 01:35:23.163296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 192/395] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:35:20 2022] POST /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/os-volume_attachments => generated 194 bytes in 2370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:35:23.187043 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-30b804b3-0d3f-41db-8526-edafe009ae82 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:23.187741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-30b804b3-0d3f-41db-8526-edafe009ae82 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:23.195021 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-30b804b3-0d3f-41db-8526-edafe009ae82 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:23.195794 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-30b804b3-0d3f-41db-8526-edafe009ae82 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:23.200454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-30b804b3-0d3f-41db-8526-edafe009ae82 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:23.214227 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-30b804b3-0d3f-41db-8526-edafe009ae82 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:23.215067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-30b804b3-0d3f-41db-8526-edafe009ae82 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:23.215741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-30b804b3-0d3f-41db-8526-edafe009ae82 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:23.445119 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-30b804b3-0d3f-41db-8526-edafe009ae82 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:23.454302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-30b804b3-0d3f-41db-8526-edafe009ae82 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:23.455886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-30b804b3-0d3f-41db-8526-edafe009ae82 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:23.464867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-30b804b3-0d3f-41db-8526-edafe009ae82 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.275922 Sep 03 01:35:23.464867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 193/396] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:23 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:23.572169 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-2d77bdc1-8300-4884-86d4-c2510ce21af0 req-9bd25ca9-6e9c-4c08-bdce-f97b004abd1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "981601c6-5b5e-494b-b553-c785dd79ceb6", "name": "network-vif-deleted", "tag": "a2d2b55e-0e55-466f-99f4-6e63ae698e3b"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:23.574935 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0073b0fc-96d8-45d5-99a5-14e862418595 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:23.586014 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-2d77bdc1-8300-4884-86d4-c2510ce21af0 req-9bd25ca9-6e9c-4c08-bdce-f97b004abd1f service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:23.586733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-2d77bdc1-8300-4884-86d4-c2510ce21af0 req-9bd25ca9-6e9c-4c08-bdce-f97b004abd1f service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:23.587169 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-2d77bdc1-8300-4884-86d4-c2510ce21af0 req-9bd25ca9-6e9c-4c08-bdce-f97b004abd1f service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:23.602840 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0073b0fc-96d8-45d5-99a5-14e862418595 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1372 microversion: 2.1 time: 0.499546 Sep 03 01:35:23.604571 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 204/397] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:23 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1372 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:23.612905 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-2d77bdc1-8300-4884-86d4-c2510ce21af0 req-9bd25ca9-6e9c-4c08-bdce-f97b004abd1f service nova] Creating event network-vif-deleted:a2d2b55e-0e55-466f-99f4-6e63ae698e3b for instance 981601c6-5b5e-494b-b553-c785dd79ceb6 on hv-cinder-83800 Sep 03 01:35:23.621757 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-2d77bdc1-8300-4884-86d4-c2510ce21af0 req-9bd25ca9-6e9c-4c08-bdce-f97b004abd1f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059105 Sep 03 01:35:23.629788 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 194/398] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:35:24.126440 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-56400aea-9be1-40a8-a798-39fdd7440ecb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:24.127066 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-56400aea-9be1-40a8-a798-39fdd7440ecb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:24.136321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-56400aea-9be1-40a8-a798-39fdd7440ecb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:24.137166 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-56400aea-9be1-40a8-a798-39fdd7440ecb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:24.137946 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-56400aea-9be1-40a8-a798-39fdd7440ecb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:24.139725 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-56400aea-9be1-40a8-a798-39fdd7440ecb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:24.140604 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-56400aea-9be1-40a8-a798-39fdd7440ecb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:24.141384 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-56400aea-9be1-40a8-a798-39fdd7440ecb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:24.210971 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-56400aea-9be1-40a8-a798-39fdd7440ecb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:24.218789 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-56400aea-9be1-40a8-a798-39fdd7440ecb tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1298 microversion: 2.1 time: 0.097765 Sep 03 01:35:24.219353 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 205/399] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:24 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1298 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:24.491257 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1f904885-7951-4419-b0ee-1a121e8a35ce tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:24.492895 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1f904885-7951-4419-b0ee-1a121e8a35ce tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:24.499407 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1f904885-7951-4419-b0ee-1a121e8a35ce tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:24.499899 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1f904885-7951-4419-b0ee-1a121e8a35ce tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:24.500345 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1f904885-7951-4419-b0ee-1a121e8a35ce tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:24.501149 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1f904885-7951-4419-b0ee-1a121e8a35ce tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:24.501600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1f904885-7951-4419-b0ee-1a121e8a35ce tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:24.502025 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1f904885-7951-4419-b0ee-1a121e8a35ce tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:24.646639 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1f904885-7951-4419-b0ee-1a121e8a35ce tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:24.647161 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-954c161a-0ad7-40cf-99de-59cf9d3ff88d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:24.647982 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-954c161a-0ad7-40cf-99de-59cf9d3ff88d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:24.654555 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-954c161a-0ad7-40cf-99de-59cf9d3ff88d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:24.656427 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-954c161a-0ad7-40cf-99de-59cf9d3ff88d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:24.657127 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-954c161a-0ad7-40cf-99de-59cf9d3ff88d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:24.658032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-954c161a-0ad7-40cf-99de-59cf9d3ff88d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:24.658730 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-954c161a-0ad7-40cf-99de-59cf9d3ff88d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:24.659624 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-954c161a-0ad7-40cf-99de-59cf9d3ff88d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:24.665608 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1f904885-7951-4419-b0ee-1a121e8a35ce tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:24.665608 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1f904885-7951-4419-b0ee-1a121e8a35ce tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:24.665608 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1f904885-7951-4419-b0ee-1a121e8a35ce tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.178488 Sep 03 01:35:24.666248 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 195/400] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:24 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:24.908898 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-954c161a-0ad7-40cf-99de-59cf9d3ff88d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:24.917159 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-954c161a-0ad7-40cf-99de-59cf9d3ff88d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1565 microversion: 2.1 time: 0.276787 Sep 03 01:35:24.917738 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 206/401] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:24 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1565 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:24.944303 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0b0f391d-02e9-47b6-bbae-ebc6768d8251 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:24.944892 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-0b0f391d-02e9-47b6-bbae-ebc6768d8251 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:24.951875 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b0f391d-02e9-47b6-bbae-ebc6768d8251 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:24.952370 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b0f391d-02e9-47b6-bbae-ebc6768d8251 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:24.952797 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b0f391d-02e9-47b6-bbae-ebc6768d8251 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:24.953500 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b0f391d-02e9-47b6-bbae-ebc6768d8251 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:24.953952 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b0f391d-02e9-47b6-bbae-ebc6768d8251 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:24.954390 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b0f391d-02e9-47b6-bbae-ebc6768d8251 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:25.047498 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0b0f391d-02e9-47b6-bbae-ebc6768d8251 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108354 Sep 03 01:35:25.048321 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 196/402] 10.222.0.13 () {58 vars in 1275 bytes} [Sat Sep 3 01:35:24 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:35:25.243687 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:25.244228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:25.250563 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:25.251346 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:25.251988 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:25.252895 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:25.253550 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:25.254221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:25.295720 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:25.297519 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:25.298047 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:25.298601 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lazy-loading 'fault' on Instance uuid 981601c6-5b5e-494b-b553-c785dd79ceb6 {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:35:25.363470 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b8f60af7a4957a578f21f9ea464dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efd244ba290249568e3a6f8bd3e7e814', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:25.373075 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-316a6666-4424-42c5-8134-a52e15046417 tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 200 len: 1303 microversion: 2.1 time: 0.134629 Sep 03 01:35:25.373767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 207/403] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:25 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 1303 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:25.694225 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e0bb95e5-4ee7-4e57-80a6-0ffd68ce076d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:25.695473 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e0bb95e5-4ee7-4e57-80a6-0ffd68ce076d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:25.697854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:25.702604 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0bb95e5-4ee7-4e57-80a6-0ffd68ce076d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:25.703365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0bb95e5-4ee7-4e57-80a6-0ffd68ce076d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:25.703869 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0bb95e5-4ee7-4e57-80a6-0ffd68ce076d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:25.704636 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0bb95e5-4ee7-4e57-80a6-0ffd68ce076d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:25.705353 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0bb95e5-4ee7-4e57-80a6-0ffd68ce076d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:25.705986 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0bb95e5-4ee7-4e57-80a6-0ffd68ce076d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:25.914459 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e0bb95e5-4ee7-4e57-80a6-0ffd68ce076d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:25.926072 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e0bb95e5-4ee7-4e57-80a6-0ffd68ce076d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:25.928278 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e0bb95e5-4ee7-4e57-80a6-0ffd68ce076d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:25.928802 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7c973786-0f23-4de5-8e04-4c0664275ee7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Action: 'create', calling method: .version_select at 0x7f6d24a88a60>, body: {"keypair": {"name": "tempest-keypair-1023371268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6RaN2/qH1lOo1EU6xbEVu0p+XN4+8QPxyU36B1XXwcIVOEnI1dfmD51dJw+vJXs3PICZF0clZu/L3tEcj2lTDIZVyZ7T6Vyvh/ti+a1wBwBT6fcV6NKeLTe5ZTQkVGvQ=="}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:25.929502 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e0bb95e5-4ee7-4e57-80a6-0ffd68ce076d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.240220 Sep 03 01:35:25.930261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 197/404] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:25 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:25.966706 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-7c973786-0f23-4de5-8e04-4c0664275ee7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for project 02813cf0683749ee87b039b28f1aeebb. Resources: {'key_pairs'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:35:25.972581 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-7c973786-0f23-4de5-8e04-4c0664275ee7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for user 2b9ab1983bb84318b509878b930e9402 and project 02813cf0683749ee87b039b28f1aeebb. Resources: {'key_pairs'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:35:26.125390 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7c973786-0f23-4de5-8e04-4c0664275ee7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.202775 Sep 03 01:35:26.126050 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 208/405] 10.222.0.13 () {60 vars in 1159 bytes} [Sat Sep 3 01:35:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:35:26.402649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1a0c87d4-1e4e-4ed4-bca8-1ff86f29026b tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:26.403401 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1a0c87d4-1e4e-4ed4-bca8-1ff86f29026b tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] [instance: 981601c6-5b5e-494b-b553-c785dd79ceb6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:26.412878 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1a0c87d4-1e4e-4ed4-bca8-1ff86f29026b tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:26.413693 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1a0c87d4-1e4e-4ed4-bca8-1ff86f29026b tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:26.415262 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1a0c87d4-1e4e-4ed4-bca8-1ff86f29026b tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:26.417176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1a0c87d4-1e4e-4ed4-bca8-1ff86f29026b tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:26.418034 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1a0c87d4-1e4e-4ed4-bca8-1ff86f29026b tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:26.418842 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1a0c87d4-1e4e-4ed4-bca8-1ff86f29026b tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:26.440336 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-1a0c87d4-1e4e-4ed4-bca8-1ff86f29026b tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] HTTP exception thrown: Instance 981601c6-5b5e-494b-b553-c785dd79ceb6 could not be found. Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1a0c87d4-1e4e-4ed4-bca8-1ff86f29026b tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Request method failure captured: Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 HTTP/1.1 Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq8l2A7zfk7v8zd_3hB9n26qQun4vXLtuMsTHcI-8Eqzz-QCmk8CqTqAxYtP-wprfIsDW1R4wBmAUXhOZSF3k1IDmbjMZUSRM6qRpFkBy8H4iYF3joEZJkeT4JljXlA9fwIuHCAeph8iAHc8oBjakenpYjdoMHCzHIAWXnTyllhM3rY Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: efd244ba290249568e3a6f8bd3e7e814 Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-VolumesActionsTest-1108292238 Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:35:26.443055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:35:26.444501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_efd244ba290249568e3a6f8bd3e7e814"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/efd244ba290249568e3a6f8bd3e7e814"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/efd244ba290249568e3a6f8bd3e7e814"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/efd244ba290249568e3a6f8bd3e7e814"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:35:26.444501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-VolumesActionsTest-1108292238 Sep 03 01:35:26.444501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: efd244ba290249568e3a6f8bd3e7e814 Sep 03 01:35:26.444501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-VolumesActionsTest-1108292238 Sep 03 01:35:26.444501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-VolumesActionsTest-1108292238-project Sep 03 01:35:26.444501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:35:26.444501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:35:26.444501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 205b8f60af7a4957a578f21f9ea464dd Sep 03 01:35:26.444501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-VolumesActionsTest-1108292238-project Sep 03 01:35:26.444501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:35:26.444501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 981601c6-5b5e-494b-b553-c785dd79ceb6 could not be found. Sep 03 01:35:26.444501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '981601c6-5b5e-494b-b553-c785dd79ceb6'} Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 981601c6-5b5e-494b-b553-c785dd79ceb6 could not be found. Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:35:26.445271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 981601c6-5b5e-494b-b553-c785dd79ceb6 could not be found. Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 981601c6-5b5e-494b-b553-c785dd79ceb6 could not be found. Sep 03 01:35:26.446988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:35:26.449214 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1a0c87d4-1e4e-4ed4-bca8-1ff86f29026b tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] Returning 404 to user: Instance 981601c6-5b5e-494b-b553-c785dd79ceb6 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:35:26.450392 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1a0c87d4-1e4e-4ed4-bca8-1ff86f29026b tempest-VolumesActionsTest-1108292238 tempest-VolumesActionsTest-1108292238-project] 10.222.0.13 "GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6" status: 404 len: 111 microversion: 2.1 time: 0.053568 Sep 03 01:35:26.451609 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 198/406] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:26 2022] GET /compute/v2.1/servers/981601c6-5b5e-494b-b553-c785dd79ceb6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 01:35:26.666786 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-db4209e4-9f8a-43ac-b50d-afbdf4058412 req-2f5d0b9b-beb2-4b26-8897-e3c4842ff9e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34abe46a-5361-4e96-a952-5909fad8c4f4", "tag": "885d8df4-2f3f-463e-aa94-cb8b3ae9cb29"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:26.678163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-db4209e4-9f8a-43ac-b50d-afbdf4058412 req-2f5d0b9b-beb2-4b26-8897-e3c4842ff9e6 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:26.678939 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-db4209e4-9f8a-43ac-b50d-afbdf4058412 req-2f5d0b9b-beb2-4b26-8897-e3c4842ff9e6 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:26.679531 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-db4209e4-9f8a-43ac-b50d-afbdf4058412 req-2f5d0b9b-beb2-4b26-8897-e3c4842ff9e6 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:26.694714 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-db4209e4-9f8a-43ac-b50d-afbdf4058412 req-2f5d0b9b-beb2-4b26-8897-e3c4842ff9e6 service nova] Creating event network-changed:885d8df4-2f3f-463e-aa94-cb8b3ae9cb29 for instance 34abe46a-5361-4e96-a952-5909fad8c4f4 on hv-cinder-83800 Sep 03 01:35:26.702141 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-db4209e4-9f8a-43ac-b50d-afbdf4058412 req-2f5d0b9b-beb2-4b26-8897-e3c4842ff9e6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039688 Sep 03 01:35:26.703351 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 209/407] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:35:26.955542 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1d519dd0-80de-4832-b9d5-7d976cc8f26c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:26.957129 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1d519dd0-80de-4832-b9d5-7d976cc8f26c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:26.970637 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d519dd0-80de-4832-b9d5-7d976cc8f26c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:26.972555 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d519dd0-80de-4832-b9d5-7d976cc8f26c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:26.973322 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d519dd0-80de-4832-b9d5-7d976cc8f26c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:26.975177 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d519dd0-80de-4832-b9d5-7d976cc8f26c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:26.976369 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d519dd0-80de-4832-b9d5-7d976cc8f26c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:26.978329 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d519dd0-80de-4832-b9d5-7d976cc8f26c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:27.203840 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1d519dd0-80de-4832-b9d5-7d976cc8f26c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:27.266679 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1d519dd0-80de-4832-b9d5-7d976cc8f26c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:27.273224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1d519dd0-80de-4832-b9d5-7d976cc8f26c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:27.281566 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1d519dd0-80de-4832-b9d5-7d976cc8f26c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.323298 Sep 03 01:35:27.288265 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 199/408] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:26 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:28.314279 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ca268f54-8253-45ce-928d-af9a3fd0a7fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:28.315002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ca268f54-8253-45ce-928d-af9a3fd0a7fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:28.328811 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ca268f54-8253-45ce-928d-af9a3fd0a7fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:28.328811 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ca268f54-8253-45ce-928d-af9a3fd0a7fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:28.328811 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ca268f54-8253-45ce-928d-af9a3fd0a7fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:28.329774 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ca268f54-8253-45ce-928d-af9a3fd0a7fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:28.330453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ca268f54-8253-45ce-928d-af9a3fd0a7fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:28.330863 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ca268f54-8253-45ce-928d-af9a3fd0a7fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:28.856940 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ca268f54-8253-45ce-928d-af9a3fd0a7fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:28.871709 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ca268f54-8253-45ce-928d-af9a3fd0a7fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:28.873150 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ca268f54-8253-45ce-928d-af9a3fd0a7fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:28.874415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ca268f54-8253-45ce-928d-af9a3fd0a7fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.564415 Sep 03 01:35:28.874923 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 210/409] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:28 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:29.900915 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-42a3ed75-96fb-4acb-9947-ff669d434b71 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:29.901537 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-42a3ed75-96fb-4acb-9947-ff669d434b71 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:29.918957 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-42a3ed75-96fb-4acb-9947-ff669d434b71 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:29.919860 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-42a3ed75-96fb-4acb-9947-ff669d434b71 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:29.920283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-42a3ed75-96fb-4acb-9947-ff669d434b71 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:29.920890 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-42a3ed75-96fb-4acb-9947-ff669d434b71 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:29.921345 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-42a3ed75-96fb-4acb-9947-ff669d434b71 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:29.921982 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-42a3ed75-96fb-4acb-9947-ff669d434b71 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:30.076063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-42a3ed75-96fb-4acb-9947-ff669d434b71 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:30.085418 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-42a3ed75-96fb-4acb-9947-ff669d434b71 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:30.086889 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-42a3ed75-96fb-4acb-9947-ff669d434b71 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:30.088859 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-42a3ed75-96fb-4acb-9947-ff669d434b71 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.191669 Sep 03 01:35:30.091098 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 200/410] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:29 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:30.709657 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-820312068", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7bd92e7f-f880-47a6-a573-413ea7d8bd54"}], "security_groups": [{"name": "tempest-securitygroup--1597770536"}], "key_name": "tempest-keypair-1023371268", "user_data": "}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:30.884011 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.network.neutron [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] validate_networks() for [('7bd92e7f-f880-47a6-a573-413ea7d8bd54', None, None, None, None, None)] {{(pid=127552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:35:31.118409 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9d596e5b-3c44-4f31-b363-bac5d86d45cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:31.119575 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9d596e5b-3c44-4f31-b363-bac5d86d45cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:31.127924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d596e5b-3c44-4f31-b363-bac5d86d45cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:31.128657 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d596e5b-3c44-4f31-b363-bac5d86d45cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:31.130578 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d596e5b-3c44-4f31-b363-bac5d86d45cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:31.130578 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d596e5b-3c44-4f31-b363-bac5d86d45cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:31.131174 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d596e5b-3c44-4f31-b363-bac5d86d45cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:31.131758 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d596e5b-3c44-4f31-b363-bac5d86d45cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:31.274383 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9d596e5b-3c44-4f31-b363-bac5d86d45cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:31.283895 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9d596e5b-3c44-4f31-b363-bac5d86d45cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:31.285655 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9d596e5b-3c44-4f31-b363-bac5d86d45cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:31.287743 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9d596e5b-3c44-4f31-b363-bac5d86d45cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.174979 Sep 03 01:35:31.288302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 201/411] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:31 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:31.474235 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Flavor limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:35:31.474708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Image limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:35:31.475372 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Flavor pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:35:31.475780 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Image pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:35:31.476185 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:35:31.486608 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:31.487089 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:31.487521 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:31.488240 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:31.492948 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:31.492948 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:31.507686 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for project 02813cf0683749ee87b039b28f1aeebb. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:35:31.511623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for user 2b9ab1983bb84318b509878b930e9402 and project 02813cf0683749ee87b039b28f1aeebb. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:35:31.525564 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Going to run 1 instances... {{(pid=127552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:35:31.527943 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:35:31.676070 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-22287732-9fd4-442f-be01-689db3e8d031 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.973373 Sep 03 01:35:31.683572 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 211/412] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:35:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:35:31.689784 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-51c97ab9-4ecb-4fac-a8cf-fe7fab0f18de tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:31.693806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-51c97ab9-4ecb-4fac-a8cf-fe7fab0f18de tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:31.764964 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-51c97ab9-4ecb-4fac-a8cf-fe7fab0f18de tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:31.773596 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-51c97ab9-4ecb-4fac-a8cf-fe7fab0f18de tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1241 microversion: 2.1 time: 0.088274 Sep 03 01:35:31.774568 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 202/413] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:31 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1241 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:32.313278 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6da55676-f932-4bfa-8713-926ba7d7bfdc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:32.314797 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6da55676-f932-4bfa-8713-926ba7d7bfdc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:32.322328 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6da55676-f932-4bfa-8713-926ba7d7bfdc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:32.323571 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6da55676-f932-4bfa-8713-926ba7d7bfdc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:32.323571 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6da55676-f932-4bfa-8713-926ba7d7bfdc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:32.324371 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6da55676-f932-4bfa-8713-926ba7d7bfdc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:32.325204 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6da55676-f932-4bfa-8713-926ba7d7bfdc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:32.325872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6da55676-f932-4bfa-8713-926ba7d7bfdc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:32.674428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6da55676-f932-4bfa-8713-926ba7d7bfdc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:32.709402 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6da55676-f932-4bfa-8713-926ba7d7bfdc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:32.709402 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6da55676-f932-4bfa-8713-926ba7d7bfdc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:32.709402 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6da55676-f932-4bfa-8713-926ba7d7bfdc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.389504 Sep 03 01:35:32.709635 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 212/414] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:32 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:32.804651 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-17f91f09-981a-447f-9213-349448f39457 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:32.805271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-17f91f09-981a-447f-9213-349448f39457 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:32.889564 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-17f91f09-981a-447f-9213-349448f39457 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:32.899491 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-17f91f09-981a-447f-9213-349448f39457 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1241 microversion: 2.1 time: 0.106265 Sep 03 01:35:32.900589 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 203/415] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:32 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:33.735961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c659a96e-e538-47cb-945f-3f52781db2ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:33.740795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c659a96e-e538-47cb-945f-3f52781db2ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:33.749277 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c659a96e-e538-47cb-945f-3f52781db2ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:33.749771 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c659a96e-e538-47cb-945f-3f52781db2ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:33.750202 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c659a96e-e538-47cb-945f-3f52781db2ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:33.750985 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c659a96e-e538-47cb-945f-3f52781db2ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:33.751430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c659a96e-e538-47cb-945f-3f52781db2ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:33.751852 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c659a96e-e538-47cb-945f-3f52781db2ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:33.923976 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1fbeaeab-9724-4d74-a852-76a1f54e0876 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:33.925283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1fbeaeab-9724-4d74-a852-76a1f54e0876 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:33.935171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1fbeaeab-9724-4d74-a852-76a1f54e0876 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:33.935171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1fbeaeab-9724-4d74-a852-76a1f54e0876 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:33.935171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1fbeaeab-9724-4d74-a852-76a1f54e0876 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:33.935171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1fbeaeab-9724-4d74-a852-76a1f54e0876 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:33.935544 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1fbeaeab-9724-4d74-a852-76a1f54e0876 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:33.935946 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1fbeaeab-9724-4d74-a852-76a1f54e0876 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:33.973727 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c659a96e-e538-47cb-945f-3f52781db2ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:33.986472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c659a96e-e538-47cb-945f-3f52781db2ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:33.987904 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c659a96e-e538-47cb-945f-3f52781db2ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:33.989151 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c659a96e-e538-47cb-945f-3f52781db2ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.257154 Sep 03 01:35:33.989714 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 213/416] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:33 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:34.031889 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1fbeaeab-9724-4d74-a852-76a1f54e0876 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:34.059415 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1fbeaeab-9724-4d74-a852-76a1f54e0876 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1293 microversion: 2.1 time: 0.135696 Sep 03 01:35:34.061649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 204/417] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:33 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1293 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:34.231632 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3fe55abf-fba7-4d48-bd9f-cfb7d35405b2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:34.246126 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3fe55abf-fba7-4d48-bd9f-cfb7d35405b2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:34.247399 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3fe55abf-fba7-4d48-bd9f-cfb7d35405b2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:34.248053 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3fe55abf-fba7-4d48-bd9f-cfb7d35405b2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:34.328302 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-3fe55abf-fba7-4d48-bd9f-cfb7d35405b2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Going to try to stop instance {{(pid=127552) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 03 01:35:34.358177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:34.546839 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3fe55abf-fba7-4d48-bd9f-cfb7d35405b2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "POST /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/action" status: 202 len: 0 microversion: 2.1 time: 0.320776 Sep 03 01:35:34.548091 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 214/418] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:35:34 2022] POST /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:35:34.557290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c1d695c6-72f1-4ba1-845b-6bb062d3e54d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:34.563540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c1d695c6-72f1-4ba1-845b-6bb062d3e54d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:34.596701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c1d695c6-72f1-4ba1-845b-6bb062d3e54d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:34.600376 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c1d695c6-72f1-4ba1-845b-6bb062d3e54d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:34.604901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c1d695c6-72f1-4ba1-845b-6bb062d3e54d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:34.624737 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c1d695c6-72f1-4ba1-845b-6bb062d3e54d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:34.628824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c1d695c6-72f1-4ba1-845b-6bb062d3e54d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:34.633306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c1d695c6-72f1-4ba1-845b-6bb062d3e54d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:35.004909 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c1d695c6-72f1-4ba1-845b-6bb062d3e54d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:35.018135 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ae6978c6-85b2-44dc-aa79-2e4af43b1bb1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:35.018950 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ae6978c6-85b2-44dc-aa79-2e4af43b1bb1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:35.029655 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c1d695c6-72f1-4ba1-845b-6bb062d3e54d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.476718 Sep 03 01:35:35.030895 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 205/419] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:34 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:35:35.032956 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae6978c6-85b2-44dc-aa79-2e4af43b1bb1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:35.033681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae6978c6-85b2-44dc-aa79-2e4af43b1bb1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:35.034303 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae6978c6-85b2-44dc-aa79-2e4af43b1bb1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:35.035216 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae6978c6-85b2-44dc-aa79-2e4af43b1bb1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:35.036862 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae6978c6-85b2-44dc-aa79-2e4af43b1bb1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:35.037446 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ae6978c6-85b2-44dc-aa79-2e4af43b1bb1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:35.094391 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-44a3788a-3c33-4e26-9da6-593153a71a73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:35.095010 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-44a3788a-3c33-4e26-9da6-593153a71a73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:35.106941 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-44a3788a-3c33-4e26-9da6-593153a71a73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:35.107671 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-44a3788a-3c33-4e26-9da6-593153a71a73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:35.108359 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-44a3788a-3c33-4e26-9da6-593153a71a73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:35.110441 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-44a3788a-3c33-4e26-9da6-593153a71a73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:35.110909 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-44a3788a-3c33-4e26-9da6-593153a71a73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:35.111340 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-44a3788a-3c33-4e26-9da6-593153a71a73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:35.243371 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-44a3788a-3c33-4e26-9da6-593153a71a73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:35.257157 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-44a3788a-3c33-4e26-9da6-593153a71a73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1301 microversion: 2.1 time: 0.166911 Sep 03 01:35:35.257774 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 206/420] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:35 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1301 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:35.588336 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ae6978c6-85b2-44dc-aa79-2e4af43b1bb1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:35.600515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ae6978c6-85b2-44dc-aa79-2e4af43b1bb1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:35.609327 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ae6978c6-85b2-44dc-aa79-2e4af43b1bb1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:35.614873 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ae6978c6-85b2-44dc-aa79-2e4af43b1bb1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.599935 Sep 03 01:35:35.615893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 215/421] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:35 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:35:36.062286 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f5908d05-8298-41a0-acfc-9cf489b98b2c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:36.064689 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f5908d05-8298-41a0-acfc-9cf489b98b2c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:36.085158 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5908d05-8298-41a0-acfc-9cf489b98b2c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:36.088702 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5908d05-8298-41a0-acfc-9cf489b98b2c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:36.089017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5908d05-8298-41a0-acfc-9cf489b98b2c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:36.091297 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5908d05-8298-41a0-acfc-9cf489b98b2c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:36.091948 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5908d05-8298-41a0-acfc-9cf489b98b2c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:36.092532 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5908d05-8298-41a0-acfc-9cf489b98b2c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:36.288136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6522b28c-c7a4-43a7-8df1-b35dba329d95 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:36.291713 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6522b28c-c7a4-43a7-8df1-b35dba329d95 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:36.310751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6522b28c-c7a4-43a7-8df1-b35dba329d95 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:36.311296 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6522b28c-c7a4-43a7-8df1-b35dba329d95 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:36.311755 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6522b28c-c7a4-43a7-8df1-b35dba329d95 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:36.312481 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6522b28c-c7a4-43a7-8df1-b35dba329d95 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:36.312939 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6522b28c-c7a4-43a7-8df1-b35dba329d95 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:36.313373 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6522b28c-c7a4-43a7-8df1-b35dba329d95 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:36.461816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-f5908d05-8298-41a0-acfc-9cf489b98b2c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:36.478790 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f5908d05-8298-41a0-acfc-9cf489b98b2c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.424814 Sep 03 01:35:36.482128 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 207/422] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:36 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:36.566414 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6522b28c-c7a4-43a7-8df1-b35dba329d95 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:36.581078 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6522b28c-c7a4-43a7-8df1-b35dba329d95 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1299 microversion: 2.1 time: 0.298223 Sep 03 01:35:36.594566 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 216/423] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:36 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1299 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:36.645404 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bbe519ee-eb94-4258-9358-ce3face4b0e5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:36.646127 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bbe519ee-eb94-4258-9358-ce3face4b0e5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:36.657688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bbe519ee-eb94-4258-9358-ce3face4b0e5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:36.658810 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bbe519ee-eb94-4258-9358-ce3face4b0e5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:36.661830 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bbe519ee-eb94-4258-9358-ce3face4b0e5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:36.665147 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bbe519ee-eb94-4258-9358-ce3face4b0e5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:36.667084 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bbe519ee-eb94-4258-9358-ce3face4b0e5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:36.673040 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bbe519ee-eb94-4258-9358-ce3face4b0e5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:37.029832 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bbe519ee-eb94-4258-9358-ce3face4b0e5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:37.041806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bbe519ee-eb94-4258-9358-ce3face4b0e5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:37.046842 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bbe519ee-eb94-4258-9358-ce3face4b0e5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:37.050194 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bbe519ee-eb94-4258-9358-ce3face4b0e5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.409608 Sep 03 01:35:37.054890 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 208/424] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:36 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:37.508746 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-fe144230-f3fa-4152-9d08-be75a4bcdb96 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:37.509636 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-fe144230-f3fa-4152-9d08-be75a4bcdb96 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:37.525561 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe144230-f3fa-4152-9d08-be75a4bcdb96 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:37.526108 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe144230-f3fa-4152-9d08-be75a4bcdb96 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:37.534159 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe144230-f3fa-4152-9d08-be75a4bcdb96 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:37.538647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe144230-f3fa-4152-9d08-be75a4bcdb96 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:37.539208 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe144230-f3fa-4152-9d08-be75a4bcdb96 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:37.539657 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe144230-f3fa-4152-9d08-be75a4bcdb96 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:37.626258 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9f5dce28-532c-4517-b110-8d39373902d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:37.627460 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9f5dce28-532c-4517-b110-8d39373902d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:37.642561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f5dce28-532c-4517-b110-8d39373902d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:37.647297 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f5dce28-532c-4517-b110-8d39373902d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:37.650739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f5dce28-532c-4517-b110-8d39373902d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:37.652239 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f5dce28-532c-4517-b110-8d39373902d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:37.657382 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f5dce28-532c-4517-b110-8d39373902d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:37.658046 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f5dce28-532c-4517-b110-8d39373902d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:38.154166 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-fe144230-f3fa-4152-9d08-be75a4bcdb96 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:38.173396 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-fe144230-f3fa-4152-9d08-be75a4bcdb96 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.669050 Sep 03 01:35:38.181935 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 217/425] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:37 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:38.187125 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-29f7ed37-46df-4131-805b-5aeadddfb3ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:38.198067 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-29f7ed37-46df-4131-805b-5aeadddfb3ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:38.207082 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-29f7ed37-46df-4131-805b-5aeadddfb3ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:38.215511 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-29f7ed37-46df-4131-805b-5aeadddfb3ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:38.233356 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9f5dce28-532c-4517-b110-8d39373902d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:38.241384 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9f5dce28-532c-4517-b110-8d39373902d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1367 microversion: 2.1 time: 0.619399 Sep 03 01:35:38.244011 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-29f7ed37-46df-4131-805b-5aeadddfb3ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:38.259020 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-29f7ed37-46df-4131-805b-5aeadddfb3ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:38.259660 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-29f7ed37-46df-4131-805b-5aeadddfb3ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:38.260107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-29f7ed37-46df-4131-805b-5aeadddfb3ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:38.265208 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 209/426] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:37 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1367 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:39.058872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-29f7ed37-46df-4131-805b-5aeadddfb3ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:39.078698 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-29f7ed37-46df-4131-805b-5aeadddfb3ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:39.085330 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-29f7ed37-46df-4131-805b-5aeadddfb3ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:39.090145 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-29f7ed37-46df-4131-805b-5aeadddfb3ab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.905654 Sep 03 01:35:39.106547 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 218/427] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:38 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:39.201914 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cfafa4f9-eb9f-419e-9c06-ddbf2b280ddb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:39.203665 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-cfafa4f9-eb9f-419e-9c06-ddbf2b280ddb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:39.220963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cfafa4f9-eb9f-419e-9c06-ddbf2b280ddb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:39.226138 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cfafa4f9-eb9f-419e-9c06-ddbf2b280ddb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:39.227514 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cfafa4f9-eb9f-419e-9c06-ddbf2b280ddb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:39.232384 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cfafa4f9-eb9f-419e-9c06-ddbf2b280ddb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:39.232996 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cfafa4f9-eb9f-419e-9c06-ddbf2b280ddb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:39.234427 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cfafa4f9-eb9f-419e-9c06-ddbf2b280ddb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:39.264871 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a139711d-6eb3-47e2-a003-69b59f53c8a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:39.265707 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a139711d-6eb3-47e2-a003-69b59f53c8a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:39.295937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a139711d-6eb3-47e2-a003-69b59f53c8a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:39.297146 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a139711d-6eb3-47e2-a003-69b59f53c8a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:39.297633 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a139711d-6eb3-47e2-a003-69b59f53c8a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:39.298416 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a139711d-6eb3-47e2-a003-69b59f53c8a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:39.298858 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a139711d-6eb3-47e2-a003-69b59f53c8a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:39.299284 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a139711d-6eb3-47e2-a003-69b59f53c8a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:39.684092 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a139711d-6eb3-47e2-a003-69b59f53c8a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:39.693292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a139711d-6eb3-47e2-a003-69b59f53c8a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1367 microversion: 2.1 time: 0.432116 Sep 03 01:35:39.694832 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 219/428] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:39 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1367 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:35:39.828502 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cfafa4f9-eb9f-419e-9c06-ddbf2b280ddb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:39.842276 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-cfafa4f9-eb9f-419e-9c06-ddbf2b280ddb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.644147 Sep 03 01:35:39.842997 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 210/429] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:39 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:40.125662 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-898306d2-43f4-4b01-afae-e018a02d6103 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:40.126448 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-898306d2-43f4-4b01-afae-e018a02d6103 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:40.128857 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:40.135506 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-898306d2-43f4-4b01-afae-e018a02d6103 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:40.136429 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-898306d2-43f4-4b01-afae-e018a02d6103 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:40.137350 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-898306d2-43f4-4b01-afae-e018a02d6103 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:40.138367 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-898306d2-43f4-4b01-afae-e018a02d6103 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:40.139077 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-898306d2-43f4-4b01-afae-e018a02d6103 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:40.140176 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-898306d2-43f4-4b01-afae-e018a02d6103 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:40.151067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-a5570850-cae9-47c7-9964-90575f1696ca req-8c42c8b2-856d-49c9-b939-ae293f66a149 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc53030-cbc9-48c7-8b91-8e23455b23b8", "tag": "d96cd46a-c8f7-49a5-bfb9-dda260e9c70a"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:40.165433 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-a5570850-cae9-47c7-9964-90575f1696ca req-8c42c8b2-856d-49c9-b939-ae293f66a149 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:40.166305 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-a5570850-cae9-47c7-9964-90575f1696ca req-8c42c8b2-856d-49c9-b939-ae293f66a149 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:40.167327 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-a5570850-cae9-47c7-9964-90575f1696ca req-8c42c8b2-856d-49c9-b939-ae293f66a149 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:40.181652 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-a5570850-cae9-47c7-9964-90575f1696ca req-8c42c8b2-856d-49c9-b939-ae293f66a149 service nova] Creating event network-changed:d96cd46a-c8f7-49a5-bfb9-dda260e9c70a for instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 on hv-cinder-83800 Sep 03 01:35:40.189671 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-a5570850-cae9-47c7-9964-90575f1696ca req-8c42c8b2-856d-49c9-b939-ae293f66a149 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040915 Sep 03 01:35:40.189671 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 211/430] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:35:40.318518 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-898306d2-43f4-4b01-afae-e018a02d6103 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:40.327988 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-898306d2-43f4-4b01-afae-e018a02d6103 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:40.330123 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-898306d2-43f4-4b01-afae-e018a02d6103 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:40.332659 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-898306d2-43f4-4b01-afae-e018a02d6103 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.214147 Sep 03 01:35:40.334388 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 220/431] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:40 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:40.721099 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b358f570-84c3-408e-a866-0970b1156cb6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:40.721610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b358f570-84c3-408e-a866-0970b1156cb6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:40.741159 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b358f570-84c3-408e-a866-0970b1156cb6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:40.741159 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b358f570-84c3-408e-a866-0970b1156cb6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:40.741159 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b358f570-84c3-408e-a866-0970b1156cb6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:40.741745 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b358f570-84c3-408e-a866-0970b1156cb6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:40.742208 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b358f570-84c3-408e-a866-0970b1156cb6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:40.747678 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b358f570-84c3-408e-a866-0970b1156cb6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:40.873323 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-26f6977e-45fa-40cd-a42f-1c6ecbf3ddbd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:40.874321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-26f6977e-45fa-40cd-a42f-1c6ecbf3ddbd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:40.901241 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-26f6977e-45fa-40cd-a42f-1c6ecbf3ddbd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:40.906991 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-26f6977e-45fa-40cd-a42f-1c6ecbf3ddbd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:40.907660 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-26f6977e-45fa-40cd-a42f-1c6ecbf3ddbd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:40.909099 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-26f6977e-45fa-40cd-a42f-1c6ecbf3ddbd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:40.917558 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-26f6977e-45fa-40cd-a42f-1c6ecbf3ddbd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:40.918482 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-26f6977e-45fa-40cd-a42f-1c6ecbf3ddbd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:41.011775 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b358f570-84c3-408e-a866-0970b1156cb6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:41.023386 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b358f570-84c3-408e-a866-0970b1156cb6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1367 microversion: 2.1 time: 0.307388 Sep 03 01:35:41.036070 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 212/432] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:40 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1367 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:41.185066 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-26f6977e-45fa-40cd-a42f-1c6ecbf3ddbd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:41.196248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-26f6977e-45fa-40cd-a42f-1c6ecbf3ddbd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.329672 Sep 03 01:35:41.199089 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 221/433] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:40 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:41.360065 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2427c36e-2f07-429a-a3c9-73bb9ce183b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:41.360995 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2427c36e-2f07-429a-a3c9-73bb9ce183b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:41.368770 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2427c36e-2f07-429a-a3c9-73bb9ce183b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:41.369518 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2427c36e-2f07-429a-a3c9-73bb9ce183b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:41.370153 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2427c36e-2f07-429a-a3c9-73bb9ce183b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:41.371117 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2427c36e-2f07-429a-a3c9-73bb9ce183b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:41.371577 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2427c36e-2f07-429a-a3c9-73bb9ce183b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:41.371998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2427c36e-2f07-429a-a3c9-73bb9ce183b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:41.395366 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:41.736935 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2427c36e-2f07-429a-a3c9-73bb9ce183b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:41.746070 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2427c36e-2f07-429a-a3c9-73bb9ce183b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:41.749340 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2427c36e-2f07-429a-a3c9-73bb9ce183b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:41.749340 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2427c36e-2f07-429a-a3c9-73bb9ce183b0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.392657 Sep 03 01:35:41.749889 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 213/434] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:41 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:42.053364 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e80b5848-f915-4a05-be81-f34e42034bff tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:42.054651 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e80b5848-f915-4a05-be81-f34e42034bff tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:42.060962 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:42.063530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=10 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:42.077676 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e80b5848-f915-4a05-be81-f34e42034bff tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:42.078502 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e80b5848-f915-4a05-be81-f34e42034bff tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:42.079268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e80b5848-f915-4a05-be81-f34e42034bff tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:42.080154 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e80b5848-f915-4a05-be81-f34e42034bff tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:42.080779 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e80b5848-f915-4a05-be81-f34e42034bff tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:42.081391 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e80b5848-f915-4a05-be81-f34e42034bff tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:42.221786 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a2448286-122c-4d31-98f0-4e18a41a631f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:42.222487 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a2448286-122c-4d31-98f0-4e18a41a631f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:42.245507 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2448286-122c-4d31-98f0-4e18a41a631f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:42.245507 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2448286-122c-4d31-98f0-4e18a41a631f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:42.245894 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2448286-122c-4d31-98f0-4e18a41a631f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:42.248552 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2448286-122c-4d31-98f0-4e18a41a631f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:42.249105 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2448286-122c-4d31-98f0-4e18a41a631f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:42.251731 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2448286-122c-4d31-98f0-4e18a41a631f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:42.362011 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e80b5848-f915-4a05-be81-f34e42034bff tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:42.372643 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e80b5848-f915-4a05-be81-f34e42034bff tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1367 microversion: 2.1 time: 0.325147 Sep 03 01:35:42.378016 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 222/435] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:42 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1367 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:42.618213 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a2448286-122c-4d31-98f0-4e18a41a631f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:42.634597 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a2448286-122c-4d31-98f0-4e18a41a631f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.417152 Sep 03 01:35:42.650792 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 214/436] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:42 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:35:42.778063 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-bd26a6ed-96a9-4733-a564-6d213d1631fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:42.779255 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-bd26a6ed-96a9-4733-a564-6d213d1631fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:42.791237 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bd26a6ed-96a9-4733-a564-6d213d1631fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:42.792311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bd26a6ed-96a9-4733-a564-6d213d1631fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:42.793079 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bd26a6ed-96a9-4733-a564-6d213d1631fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:42.794207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bd26a6ed-96a9-4733-a564-6d213d1631fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:42.794908 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bd26a6ed-96a9-4733-a564-6d213d1631fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:42.795590 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bd26a6ed-96a9-4733-a564-6d213d1631fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:43.141058 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bd26a6ed-96a9-4733-a564-6d213d1631fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:43.160009 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bd26a6ed-96a9-4733-a564-6d213d1631fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:43.162279 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bd26a6ed-96a9-4733-a564-6d213d1631fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:43.163636 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-bd26a6ed-96a9-4733-a564-6d213d1631fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.389912 Sep 03 01:35:43.173749 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 223/437] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:42 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:43.405595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-eae3e8c2-b610-48fc-912a-f672deced649 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:43.406932 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-eae3e8c2-b610-48fc-912a-f672deced649 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:43.414945 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=4 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:43.420951 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eae3e8c2-b610-48fc-912a-f672deced649 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:43.425796 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eae3e8c2-b610-48fc-912a-f672deced649 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:43.427077 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eae3e8c2-b610-48fc-912a-f672deced649 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:43.427943 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eae3e8c2-b610-48fc-912a-f672deced649 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:43.428639 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eae3e8c2-b610-48fc-912a-f672deced649 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:43.429282 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eae3e8c2-b610-48fc-912a-f672deced649 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:43.663847 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6f09ddda-2efb-418f-bfd0-6dae5110df40 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:43.665027 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6f09ddda-2efb-418f-bfd0-6dae5110df40 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:43.693415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f09ddda-2efb-418f-bfd0-6dae5110df40 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:43.693926 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f09ddda-2efb-418f-bfd0-6dae5110df40 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:43.700929 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f09ddda-2efb-418f-bfd0-6dae5110df40 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:43.701448 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f09ddda-2efb-418f-bfd0-6dae5110df40 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:43.705411 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-eae3e8c2-b610-48fc-912a-f672deced649 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:43.707563 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f09ddda-2efb-418f-bfd0-6dae5110df40 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:43.711449 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f09ddda-2efb-418f-bfd0-6dae5110df40 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:43.715106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-eae3e8c2-b610-48fc-912a-f672deced649 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1367 microversion: 2.1 time: 0.314073 Sep 03 01:35:43.716340 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 215/438] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:43 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:44.047855 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6f09ddda-2efb-418f-bfd0-6dae5110df40 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:44.062031 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6f09ddda-2efb-418f-bfd0-6dae5110df40 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.403670 Sep 03 01:35:44.074267 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 224/439] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:43 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:44.195880 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-87c007ba-1631-4f39-8bae-6dbb3a59fe4a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:44.196864 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-87c007ba-1631-4f39-8bae-6dbb3a59fe4a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:44.211675 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-87c007ba-1631-4f39-8bae-6dbb3a59fe4a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:44.214137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-87c007ba-1631-4f39-8bae-6dbb3a59fe4a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:44.215578 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-87c007ba-1631-4f39-8bae-6dbb3a59fe4a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:44.218682 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-87c007ba-1631-4f39-8bae-6dbb3a59fe4a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:44.221415 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-87c007ba-1631-4f39-8bae-6dbb3a59fe4a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:44.222516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-87c007ba-1631-4f39-8bae-6dbb3a59fe4a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:44.455982 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-87c007ba-1631-4f39-8bae-6dbb3a59fe4a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:44.466734 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-87c007ba-1631-4f39-8bae-6dbb3a59fe4a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:44.468451 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-87c007ba-1631-4f39-8bae-6dbb3a59fe4a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:44.469711 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-87c007ba-1631-4f39-8bae-6dbb3a59fe4a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1745 microversion: 2.20 time: 0.280122 Sep 03 01:35:44.470672 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 216/440] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:44 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1745 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:35:44.738737 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e1ddbed3-c774-468f-b927-b80427a3e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:44.739551 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e1ddbed3-c774-468f-b927-b80427a3e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:44.752818 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e1ddbed3-c774-468f-b927-b80427a3e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:44.754750 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e1ddbed3-c774-468f-b927-b80427a3e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:44.755451 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e1ddbed3-c774-468f-b927-b80427a3e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:44.757785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e1ddbed3-c774-468f-b927-b80427a3e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:44.759518 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e1ddbed3-c774-468f-b927-b80427a3e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:44.762593 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e1ddbed3-c774-468f-b927-b80427a3e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:45.112342 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6575783d-63e1-4ac6-85c9-bdfefdd8bb33 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:45.141065 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6575783d-63e1-4ac6-85c9-bdfefdd8bb33 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:45.141065 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6575783d-63e1-4ac6-85c9-bdfefdd8bb33 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:45.141065 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6575783d-63e1-4ac6-85c9-bdfefdd8bb33 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:45.141065 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6575783d-63e1-4ac6-85c9-bdfefdd8bb33 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:45.141561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6575783d-63e1-4ac6-85c9-bdfefdd8bb33 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:45.141561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6575783d-63e1-4ac6-85c9-bdfefdd8bb33 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:45.141561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6575783d-63e1-4ac6-85c9-bdfefdd8bb33 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:45.416004 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6575783d-63e1-4ac6-85c9-bdfefdd8bb33 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:45.428590 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6575783d-63e1-4ac6-85c9-bdfefdd8bb33 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.322607 Sep 03 01:35:45.434268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e1ddbed3-c774-468f-b927-b80427a3e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:45.445081 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 217/441] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:45 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:45.450483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e1ddbed3-c774-468f-b927-b80427a3e086 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1367 microversion: 2.1 time: 0.711673 Sep 03 01:35:45.450483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 225/442] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:44 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1367 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:45.500017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-61751705-1c89-484a-b86b-870defaf42d3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:45.502801 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-61751705-1c89-484a-b86b-870defaf42d3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:45.513088 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-61751705-1c89-484a-b86b-870defaf42d3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:45.513864 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-61751705-1c89-484a-b86b-870defaf42d3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:45.514629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-61751705-1c89-484a-b86b-870defaf42d3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:45.515744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-61751705-1c89-484a-b86b-870defaf42d3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:45.516343 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-61751705-1c89-484a-b86b-870defaf42d3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:45.516906 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-61751705-1c89-484a-b86b-870defaf42d3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:45.896990 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-61751705-1c89-484a-b86b-870defaf42d3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:45.912912 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-61751705-1c89-484a-b86b-870defaf42d3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:45.916875 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-61751705-1c89-484a-b86b-870defaf42d3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:45.917522 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-61751705-1c89-484a-b86b-870defaf42d3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1745 microversion: 2.20 time: 0.421095 Sep 03 01:35:45.929428 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 218/443] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:45 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1745 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:46.374158 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-31c33eb6-90f1-44af-a88e-0778d7611be1 req-cc588fd1-a94b-4523-938f-c8c352f0ed6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329ea656-c337-4f07-bd3d-9f67c4d6418e", "name": "network-vif-plugged", "status": "completed", "tag": "8e331545-f680-453c-942e-5cd9fc274b5f"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:46.393354 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-31c33eb6-90f1-44af-a88e-0778d7611be1 req-cc588fd1-a94b-4523-938f-c8c352f0ed6b service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:46.394055 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-31c33eb6-90f1-44af-a88e-0778d7611be1 req-cc588fd1-a94b-4523-938f-c8c352f0ed6b service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:46.394780 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-31c33eb6-90f1-44af-a88e-0778d7611be1 req-cc588fd1-a94b-4523-938f-c8c352f0ed6b service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:46.412737 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-31c33eb6-90f1-44af-a88e-0778d7611be1 req-cc588fd1-a94b-4523-938f-c8c352f0ed6b service nova] Creating event network-vif-plugged:8e331545-f680-453c-942e-5cd9fc274b5f for instance 329ea656-c337-4f07-bd3d-9f67c4d6418e on hv-cinder-83800 Sep 03 01:35:46.430098 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-31c33eb6-90f1-44af-a88e-0778d7611be1 req-cc588fd1-a94b-4523-938f-c8c352f0ed6b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058660 Sep 03 01:35:46.433377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 226/444] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:35:46.479180 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-495ee774-3aa8-427b-b1e9-04c951c19050 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:46.481106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-18126759-3c43-4625-914f-95dbb66562a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:46.481964 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-18126759-3c43-4625-914f-95dbb66562a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:46.484599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-495ee774-3aa8-427b-b1e9-04c951c19050 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:46.504280 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-18126759-3c43-4625-914f-95dbb66562a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:46.504867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-18126759-3c43-4625-914f-95dbb66562a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:46.505202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-18126759-3c43-4625-914f-95dbb66562a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:46.505910 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-18126759-3c43-4625-914f-95dbb66562a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:46.506375 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-18126759-3c43-4625-914f-95dbb66562a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:46.506996 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-18126759-3c43-4625-914f-95dbb66562a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:46.507122 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-495ee774-3aa8-427b-b1e9-04c951c19050 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:46.507533 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-495ee774-3aa8-427b-b1e9-04c951c19050 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:46.509133 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-495ee774-3aa8-427b-b1e9-04c951c19050 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:46.514099 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-495ee774-3aa8-427b-b1e9-04c951c19050 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:46.514820 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-495ee774-3aa8-427b-b1e9-04c951c19050 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:46.520336 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-495ee774-3aa8-427b-b1e9-04c951c19050 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:46.715763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-495ee774-3aa8-427b-b1e9-04c951c19050 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:46.730434 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-495ee774-3aa8-427b-b1e9-04c951c19050 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.257907 Sep 03 01:35:46.731025 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 227/445] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:46 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:46.946036 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cb34489a-eb6c-4bb5-aebf-b5d82472a10e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:46.947097 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cb34489a-eb6c-4bb5-aebf-b5d82472a10e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:46.959534 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cb34489a-eb6c-4bb5-aebf-b5d82472a10e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:46.961378 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cb34489a-eb6c-4bb5-aebf-b5d82472a10e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:46.963232 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cb34489a-eb6c-4bb5-aebf-b5d82472a10e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:46.964419 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cb34489a-eb6c-4bb5-aebf-b5d82472a10e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:46.966268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cb34489a-eb6c-4bb5-aebf-b5d82472a10e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:46.968880 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cb34489a-eb6c-4bb5-aebf-b5d82472a10e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:47.027764 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-18126759-3c43-4625-914f-95dbb66562a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:47.042469 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-18126759-3c43-4625-914f-95dbb66562a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1367 microversion: 2.1 time: 0.573654 Sep 03 01:35:47.044012 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 219/446] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:46 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1367 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:47.294202 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cb34489a-eb6c-4bb5-aebf-b5d82472a10e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:47.306265 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cb34489a-eb6c-4bb5-aebf-b5d82472a10e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:47.311642 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cb34489a-eb6c-4bb5-aebf-b5d82472a10e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:47.315428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cb34489a-eb6c-4bb5-aebf-b5d82472a10e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1745 microversion: 2.20 time: 0.374121 Sep 03 01:35:47.328996 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 228/447] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:46 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1745 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:47.763468 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-aa74a069-d1aa-4066-9e97-f84019134f87 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:47.764847 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-aa74a069-d1aa-4066-9e97-f84019134f87 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:47.773605 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa74a069-d1aa-4066-9e97-f84019134f87 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:47.774403 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa74a069-d1aa-4066-9e97-f84019134f87 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:47.775087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa74a069-d1aa-4066-9e97-f84019134f87 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:47.775972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa74a069-d1aa-4066-9e97-f84019134f87 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:47.776755 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa74a069-d1aa-4066-9e97-f84019134f87 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:47.777380 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa74a069-d1aa-4066-9e97-f84019134f87 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:48.017367 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-aa74a069-d1aa-4066-9e97-f84019134f87 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:48.027370 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-aa74a069-d1aa-4066-9e97-f84019134f87 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.274083 Sep 03 01:35:48.047872 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 220/448] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:47 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:35:48.069819 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5905e57b-3d9c-419d-bee7-89eaacaa2761 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:48.069819 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5905e57b-3d9c-419d-bee7-89eaacaa2761 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:48.079424 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5905e57b-3d9c-419d-bee7-89eaacaa2761 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:48.080268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5905e57b-3d9c-419d-bee7-89eaacaa2761 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:48.081535 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5905e57b-3d9c-419d-bee7-89eaacaa2761 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:48.082612 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5905e57b-3d9c-419d-bee7-89eaacaa2761 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:48.083508 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5905e57b-3d9c-419d-bee7-89eaacaa2761 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:48.084144 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5905e57b-3d9c-419d-bee7-89eaacaa2761 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:48.357041 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-07a9c3b6-0d3d-4146-a3f2-e2db1641e1cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:48.358475 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-07a9c3b6-0d3d-4146-a3f2-e2db1641e1cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:48.368300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5905e57b-3d9c-419d-bee7-89eaacaa2761 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:48.378695 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5905e57b-3d9c-419d-bee7-89eaacaa2761 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1367 microversion: 2.1 time: 0.316029 Sep 03 01:35:48.390426 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 229/449] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:48 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:48.411010 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07a9c3b6-0d3d-4146-a3f2-e2db1641e1cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:48.411792 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07a9c3b6-0d3d-4146-a3f2-e2db1641e1cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:48.412314 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07a9c3b6-0d3d-4146-a3f2-e2db1641e1cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:48.413067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07a9c3b6-0d3d-4146-a3f2-e2db1641e1cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:48.413527 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07a9c3b6-0d3d-4146-a3f2-e2db1641e1cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:48.415947 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-07a9c3b6-0d3d-4146-a3f2-e2db1641e1cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:48.857071 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-07a9c3b6-0d3d-4146-a3f2-e2db1641e1cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:48.870433 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-07a9c3b6-0d3d-4146-a3f2-e2db1641e1cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:48.872895 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-07a9c3b6-0d3d-4146-a3f2-e2db1641e1cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:48.874421 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-07a9c3b6-0d3d-4146-a3f2-e2db1641e1cf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.522867 Sep 03 01:35:48.875942 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 221/450] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:48 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:49.055050 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0ac9c7f8-3923-4320-b186-67ebf7f37d30 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:49.055678 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0ac9c7f8-3923-4320-b186-67ebf7f37d30 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:49.071428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ac9c7f8-3923-4320-b186-67ebf7f37d30 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:49.078139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ac9c7f8-3923-4320-b186-67ebf7f37d30 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:49.080892 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ac9c7f8-3923-4320-b186-67ebf7f37d30 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:49.085414 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ac9c7f8-3923-4320-b186-67ebf7f37d30 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:49.089305 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ac9c7f8-3923-4320-b186-67ebf7f37d30 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:49.090918 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ac9c7f8-3923-4320-b186-67ebf7f37d30 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:49.412103 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1d8facdd-07fd-4834-ae91-f26c6b3aa735 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:49.414029 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1d8facdd-07fd-4834-ae91-f26c6b3aa735 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:49.458567 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d8facdd-07fd-4834-ae91-f26c6b3aa735 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:49.459062 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d8facdd-07fd-4834-ae91-f26c6b3aa735 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:49.478652 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d8facdd-07fd-4834-ae91-f26c6b3aa735 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:49.483444 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d8facdd-07fd-4834-ae91-f26c6b3aa735 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:49.487715 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d8facdd-07fd-4834-ae91-f26c6b3aa735 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:49.499031 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d8facdd-07fd-4834-ae91-f26c6b3aa735 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:49.575697 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0ac9c7f8-3923-4320-b186-67ebf7f37d30 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:49.601762 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0ac9c7f8-3923-4320-b186-67ebf7f37d30 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.553297 Sep 03 01:35:49.614422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 230/451] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:49 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:49.907071 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6c2f52b0-36b0-467d-9a0c-77e7a9d283e2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:49.907831 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6c2f52b0-36b0-467d-9a0c-77e7a9d283e2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:49.924346 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6c2f52b0-36b0-467d-9a0c-77e7a9d283e2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:49.924835 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6c2f52b0-36b0-467d-9a0c-77e7a9d283e2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:49.925277 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6c2f52b0-36b0-467d-9a0c-77e7a9d283e2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:49.938975 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6c2f52b0-36b0-467d-9a0c-77e7a9d283e2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:49.938975 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6c2f52b0-36b0-467d-9a0c-77e7a9d283e2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:49.938975 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6c2f52b0-36b0-467d-9a0c-77e7a9d283e2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:50.014527 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:50.061970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1d8facdd-07fd-4834-ae91-f26c6b3aa735 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:50.070063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1d8facdd-07fd-4834-ae91-f26c6b3aa735 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1367 microversion: 2.1 time: 0.667905 Sep 03 01:35:50.078735 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 222/452] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:49 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1367 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:50.592537 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6c2f52b0-36b0-467d-9a0c-77e7a9d283e2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:50.612041 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6c2f52b0-36b0-467d-9a0c-77e7a9d283e2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:50.615526 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6c2f52b0-36b0-467d-9a0c-77e7a9d283e2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:50.615955 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6c2f52b0-36b0-467d-9a0c-77e7a9d283e2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.714754 Sep 03 01:35:50.638400 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 231/453] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:49 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:35:50.638645 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9d493f5a-f9ef-4594-bbe4-f24a627caaa2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:50.638645 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9d493f5a-f9ef-4594-bbe4-f24a627caaa2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:50.655383 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d493f5a-f9ef-4594-bbe4-f24a627caaa2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:50.656007 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d493f5a-f9ef-4594-bbe4-f24a627caaa2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:50.667061 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d493f5a-f9ef-4594-bbe4-f24a627caaa2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:50.668188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d493f5a-f9ef-4594-bbe4-f24a627caaa2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:50.668685 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d493f5a-f9ef-4594-bbe4-f24a627caaa2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:50.669130 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d493f5a-f9ef-4594-bbe4-f24a627caaa2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:51.045062 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9d493f5a-f9ef-4594-bbe4-f24a627caaa2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:51.091227 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9d493f5a-f9ef-4594-bbe4-f24a627caaa2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.457912 Sep 03 01:35:51.113859 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a260ff7b-bd4c-4416-aae9-ce7af4d8c1d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:51.117632 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a260ff7b-bd4c-4416-aae9-ce7af4d8c1d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:51.126225 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 223/454] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:50 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:51.136416 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a260ff7b-bd4c-4416-aae9-ce7af4d8c1d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:51.141669 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a260ff7b-bd4c-4416-aae9-ce7af4d8c1d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:51.143574 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a260ff7b-bd4c-4416-aae9-ce7af4d8c1d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:51.146069 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a260ff7b-bd4c-4416-aae9-ce7af4d8c1d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:51.149679 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a260ff7b-bd4c-4416-aae9-ce7af4d8c1d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:51.150366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a260ff7b-bd4c-4416-aae9-ce7af4d8c1d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:51.576302 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a260ff7b-bd4c-4416-aae9-ce7af4d8c1d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:51.591028 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a260ff7b-bd4c-4416-aae9-ce7af4d8c1d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1367 microversion: 2.1 time: 0.480889 Sep 03 01:35:51.592114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 232/455] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:51 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:51.656984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7f6a1a25-15a1-4943-84ea-e3211225ed2f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:51.666358 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7f6a1a25-15a1-4943-84ea-e3211225ed2f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:51.678048 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f6a1a25-15a1-4943-84ea-e3211225ed2f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:51.680931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f6a1a25-15a1-4943-84ea-e3211225ed2f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:51.686477 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f6a1a25-15a1-4943-84ea-e3211225ed2f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:51.687795 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f6a1a25-15a1-4943-84ea-e3211225ed2f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:51.688580 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f6a1a25-15a1-4943-84ea-e3211225ed2f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:51.689415 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f6a1a25-15a1-4943-84ea-e3211225ed2f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:51.998652 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7f6a1a25-15a1-4943-84ea-e3211225ed2f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:52.025055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7f6a1a25-15a1-4943-84ea-e3211225ed2f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:52.026973 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7f6a1a25-15a1-4943-84ea-e3211225ed2f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:52.032003 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7f6a1a25-15a1-4943-84ea-e3211225ed2f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.381589 Sep 03 01:35:52.038786 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 224/456] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:51 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:52.119436 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ed7e8f44-ce9c-4d9b-8a5a-9aa3b494c8b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:52.120041 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ed7e8f44-ce9c-4d9b-8a5a-9aa3b494c8b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:52.139257 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7e8f44-ce9c-4d9b-8a5a-9aa3b494c8b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:52.139752 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7e8f44-ce9c-4d9b-8a5a-9aa3b494c8b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:52.140211 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7e8f44-ce9c-4d9b-8a5a-9aa3b494c8b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:52.141088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7e8f44-ce9c-4d9b-8a5a-9aa3b494c8b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:52.141417 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7e8f44-ce9c-4d9b-8a5a-9aa3b494c8b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:52.141960 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7e8f44-ce9c-4d9b-8a5a-9aa3b494c8b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:52.547842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ed7e8f44-ce9c-4d9b-8a5a-9aa3b494c8b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:52.559742 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ed7e8f44-ce9c-4d9b-8a5a-9aa3b494c8b1 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.447472 Sep 03 01:35:52.593921 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 233/457] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:52 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:52.615880 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-515e77bd-3265-474c-b4fd-6ab7916f6eef tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:52.616927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-515e77bd-3265-474c-b4fd-6ab7916f6eef tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:52.630990 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-515e77bd-3265-474c-b4fd-6ab7916f6eef tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:52.633365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-515e77bd-3265-474c-b4fd-6ab7916f6eef tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:52.635760 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-515e77bd-3265-474c-b4fd-6ab7916f6eef tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:52.640861 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-515e77bd-3265-474c-b4fd-6ab7916f6eef tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:52.641515 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-515e77bd-3265-474c-b4fd-6ab7916f6eef tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:52.643308 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-515e77bd-3265-474c-b4fd-6ab7916f6eef tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:53.067900 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f10e4c93-4804-4c53-acd9-0e54c260bca9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:53.068879 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f10e4c93-4804-4c53-acd9-0e54c260bca9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:53.080719 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f10e4c93-4804-4c53-acd9-0e54c260bca9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:53.082825 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f10e4c93-4804-4c53-acd9-0e54c260bca9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:53.088104 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f10e4c93-4804-4c53-acd9-0e54c260bca9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:53.088104 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f10e4c93-4804-4c53-acd9-0e54c260bca9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:53.088104 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f10e4c93-4804-4c53-acd9-0e54c260bca9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:53.088104 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f10e4c93-4804-4c53-acd9-0e54c260bca9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:53.210047 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-515e77bd-3265-474c-b4fd-6ab7916f6eef tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:53.220273 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-515e77bd-3265-474c-b4fd-6ab7916f6eef tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1367 microversion: 2.1 time: 0.608803 Sep 03 01:35:53.223034 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 225/458] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:52 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1367 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:53.411488 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-5037fff1-f798-4854-afa0-fdecd9f2db00 req-c82387b7-407a-419d-b9d9-08724589a8bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc53030-cbc9-48c7-8b91-8e23455b23b8", "name": "network-vif-plugged", "status": "completed", "tag": "d96cd46a-c8f7-49a5-bfb9-dda260e9c70a"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:35:53.427954 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-5037fff1-f798-4854-afa0-fdecd9f2db00 req-c82387b7-407a-419d-b9d9-08724589a8bd service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:53.430988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-5037fff1-f798-4854-afa0-fdecd9f2db00 req-c82387b7-407a-419d-b9d9-08724589a8bd service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:53.432746 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-5037fff1-f798-4854-afa0-fdecd9f2db00 req-c82387b7-407a-419d-b9d9-08724589a8bd service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:53.459573 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-5037fff1-f798-4854-afa0-fdecd9f2db00 req-c82387b7-407a-419d-b9d9-08724589a8bd service nova] Creating event network-vif-plugged:d96cd46a-c8f7-49a5-bfb9-dda260e9c70a for instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 on hv-cinder-83800 Sep 03 01:35:53.464393 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f10e4c93-4804-4c53-acd9-0e54c260bca9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:53.477679 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f10e4c93-4804-4c53-acd9-0e54c260bca9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:53.478364 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-5037fff1-f798-4854-afa0-fdecd9f2db00 req-c82387b7-407a-419d-b9d9-08724589a8bd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070634 Sep 03 01:35:53.479711 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 226/459] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:35:53.481483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f10e4c93-4804-4c53-acd9-0e54c260bca9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:53.483004 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f10e4c93-4804-4c53-acd9-0e54c260bca9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.419970 Sep 03 01:35:53.483985 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 234/460] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:53 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:53.605797 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6a867760-cc1e-4d76-9702-a127860b5b81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:53.606269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6a867760-cc1e-4d76-9702-a127860b5b81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:53.623891 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6a867760-cc1e-4d76-9702-a127860b5b81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:53.624733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6a867760-cc1e-4d76-9702-a127860b5b81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:53.624876 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6a867760-cc1e-4d76-9702-a127860b5b81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:53.625932 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6a867760-cc1e-4d76-9702-a127860b5b81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:53.626432 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6a867760-cc1e-4d76-9702-a127860b5b81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:53.626862 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6a867760-cc1e-4d76-9702-a127860b5b81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:54.053757 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6a867760-cc1e-4d76-9702-a127860b5b81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:54.080843 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6a867760-cc1e-4d76-9702-a127860b5b81 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.483425 Sep 03 01:35:54.086441 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 227/461] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:53 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:54.249934 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cd3cd60b-7a04-400c-b385-b84232e9fd98 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:54.250623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cd3cd60b-7a04-400c-b385-b84232e9fd98 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:54.266658 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd3cd60b-7a04-400c-b385-b84232e9fd98 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:54.270909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd3cd60b-7a04-400c-b385-b84232e9fd98 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:54.270909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd3cd60b-7a04-400c-b385-b84232e9fd98 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:54.270909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd3cd60b-7a04-400c-b385-b84232e9fd98 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:54.274741 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd3cd60b-7a04-400c-b385-b84232e9fd98 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:54.276368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd3cd60b-7a04-400c-b385-b84232e9fd98 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:54.510445 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4b6c91c2-9385-4b71-adb8-220d9c516ef0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:54.511748 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4b6c91c2-9385-4b71-adb8-220d9c516ef0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:54.521973 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4b6c91c2-9385-4b71-adb8-220d9c516ef0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:54.522677 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4b6c91c2-9385-4b71-adb8-220d9c516ef0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:54.523306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4b6c91c2-9385-4b71-adb8-220d9c516ef0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:54.528905 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4b6c91c2-9385-4b71-adb8-220d9c516ef0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:54.532515 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4b6c91c2-9385-4b71-adb8-220d9c516ef0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:54.540597 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4b6c91c2-9385-4b71-adb8-220d9c516ef0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:54.712786 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cd3cd60b-7a04-400c-b385-b84232e9fd98 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:54.724919 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cd3cd60b-7a04-400c-b385-b84232e9fd98 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1367 microversion: 2.1 time: 0.477317 Sep 03 01:35:54.728559 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 235/462] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:54 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1367 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:54.970535 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4b6c91c2-9385-4b71-adb8-220d9c516ef0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:55.001360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4b6c91c2-9385-4b71-adb8-220d9c516ef0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:55.004194 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4b6c91c2-9385-4b71-adb8-220d9c516ef0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:55.005629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4b6c91c2-9385-4b71-adb8-220d9c516ef0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.500154 Sep 03 01:35:55.006919 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 228/463] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:54 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:55.118496 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-047f5075-a759-48bd-b153-4d0a33c2d762 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:55.119448 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-047f5075-a759-48bd-b153-4d0a33c2d762 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:55.138598 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-047f5075-a759-48bd-b153-4d0a33c2d762 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:55.139626 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-047f5075-a759-48bd-b153-4d0a33c2d762 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:55.143032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-047f5075-a759-48bd-b153-4d0a33c2d762 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:55.152153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-047f5075-a759-48bd-b153-4d0a33c2d762 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:55.154543 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-047f5075-a759-48bd-b153-4d0a33c2d762 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:55.156884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-047f5075-a759-48bd-b153-4d0a33c2d762 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:55.518015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-047f5075-a759-48bd-b153-4d0a33c2d762 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:55.532424 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-047f5075-a759-48bd-b153-4d0a33c2d762 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.420658 Sep 03 01:35:55.542382 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 236/464] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:55 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:55.756820 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b4b252a0-fa02-4569-bc8f-982eb849ca8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:55.760298 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b4b252a0-fa02-4569-bc8f-982eb849ca8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:55.792534 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b4b252a0-fa02-4569-bc8f-982eb849ca8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:55.794937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b4b252a0-fa02-4569-bc8f-982eb849ca8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:55.795992 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b4b252a0-fa02-4569-bc8f-982eb849ca8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:55.800146 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b4b252a0-fa02-4569-bc8f-982eb849ca8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:55.803189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b4b252a0-fa02-4569-bc8f-982eb849ca8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:55.803866 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b4b252a0-fa02-4569-bc8f-982eb849ca8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:56.059834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7d00d1c7-8f94-4e68-beb9-9e74a062334f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:56.061194 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7d00d1c7-8f94-4e68-beb9-9e74a062334f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:56.075353 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7d00d1c7-8f94-4e68-beb9-9e74a062334f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:56.148158 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7d00d1c7-8f94-4e68-beb9-9e74a062334f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.058s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:56.148723 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7d00d1c7-8f94-4e68-beb9-9e74a062334f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:56.149485 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7d00d1c7-8f94-4e68-beb9-9e74a062334f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:56.158239 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7d00d1c7-8f94-4e68-beb9-9e74a062334f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:56.163008 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7d00d1c7-8f94-4e68-beb9-9e74a062334f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:56.348354 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b4b252a0-fa02-4569-bc8f-982eb849ca8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:56.349358 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b4b252a0-fa02-4569-bc8f-982eb849ca8c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1367 microversion: 2.1 time: 0.593311 Sep 03 01:35:56.349821 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 229/465] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:55 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1367 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:56.490828 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7d00d1c7-8f94-4e68-beb9-9e74a062334f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:56.500917 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7d00d1c7-8f94-4e68-beb9-9e74a062334f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:56.502372 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7d00d1c7-8f94-4e68-beb9-9e74a062334f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:56.504081 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7d00d1c7-8f94-4e68-beb9-9e74a062334f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.453478 Sep 03 01:35:56.514732 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 237/466] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:56 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:56.563312 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7a874ea5-2e01-46d8-9fd8-31ee8fa830fb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:56.564286 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7a874ea5-2e01-46d8-9fd8-31ee8fa830fb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:56.571192 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7a874ea5-2e01-46d8-9fd8-31ee8fa830fb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:56.571675 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7a874ea5-2e01-46d8-9fd8-31ee8fa830fb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:56.572296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7a874ea5-2e01-46d8-9fd8-31ee8fa830fb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:56.573170 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7a874ea5-2e01-46d8-9fd8-31ee8fa830fb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:56.573619 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7a874ea5-2e01-46d8-9fd8-31ee8fa830fb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:56.574332 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7a874ea5-2e01-46d8-9fd8-31ee8fa830fb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:56.739660 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7a874ea5-2e01-46d8-9fd8-31ee8fa830fb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:56.749688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=100 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:56.754974 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7a874ea5-2e01-46d8-9fd8-31ee8fa830fb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.195531 Sep 03 01:35:56.767804 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 230/467] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:56 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:57.376194 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-00627a3a-5440-48dd-af66-346f89da5305 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:57.377080 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-00627a3a-5440-48dd-af66-346f89da5305 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:57.390651 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00627a3a-5440-48dd-af66-346f89da5305 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:57.393627 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00627a3a-5440-48dd-af66-346f89da5305 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:57.404282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00627a3a-5440-48dd-af66-346f89da5305 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:57.405506 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00627a3a-5440-48dd-af66-346f89da5305 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:57.406528 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00627a3a-5440-48dd-af66-346f89da5305 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:57.407124 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00627a3a-5440-48dd-af66-346f89da5305 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:57.533671 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2e2730c9-8471-4f1a-bc42-14192a54f141 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:57.534442 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2e2730c9-8471-4f1a-bc42-14192a54f141 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:57.568855 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=72 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:35:57.577455 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e2730c9-8471-4f1a-bc42-14192a54f141 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:57.585481 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e2730c9-8471-4f1a-bc42-14192a54f141 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:57.587893 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e2730c9-8471-4f1a-bc42-14192a54f141 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:57.590485 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e2730c9-8471-4f1a-bc42-14192a54f141 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:57.595632 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e2730c9-8471-4f1a-bc42-14192a54f141 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:57.596366 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e2730c9-8471-4f1a-bc42-14192a54f141 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:57.726162 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-00627a3a-5440-48dd-af66-346f89da5305 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:57.736167 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-00627a3a-5440-48dd-af66-346f89da5305 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1556 microversion: 2.1 time: 0.364231 Sep 03 01:35:57.742276 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 238/468] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:57 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1556 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:57.766443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-71946c8a-9d79-42d4-a600-187aa1461071 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:57.767327 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-71946c8a-9d79-42d4-a600-187aa1461071 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:57.780204 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71946c8a-9d79-42d4-a600-187aa1461071 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:57.783114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71946c8a-9d79-42d4-a600-187aa1461071 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:57.785274 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71946c8a-9d79-42d4-a600-187aa1461071 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:57.786638 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71946c8a-9d79-42d4-a600-187aa1461071 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:57.788114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71946c8a-9d79-42d4-a600-187aa1461071 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:57.789975 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71946c8a-9d79-42d4-a600-187aa1461071 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:57.958385 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-71946c8a-9d79-42d4-a600-187aa1461071 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185428 Sep 03 01:35:57.958385 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 239/469] 10.222.0.13 () {58 vars in 1275 bytes} [Sat Sep 3 01:35:57 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8/os-interface => generated 284 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:35:57.965461 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-875dba95-1e92-47da-90ef-c3e616e9f0cd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:57.965461 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-875dba95-1e92-47da-90ef-c3e616e9f0cd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:57.981029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-875dba95-1e92-47da-90ef-c3e616e9f0cd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:57.981978 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-875dba95-1e92-47da-90ef-c3e616e9f0cd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:57.983332 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-875dba95-1e92-47da-90ef-c3e616e9f0cd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:57.986581 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-875dba95-1e92-47da-90ef-c3e616e9f0cd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:57.991060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-875dba95-1e92-47da-90ef-c3e616e9f0cd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:57.992106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-875dba95-1e92-47da-90ef-c3e616e9f0cd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:58.007576 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2e2730c9-8471-4f1a-bc42-14192a54f141 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:58.023592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2e2730c9-8471-4f1a-bc42-14192a54f141 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:58.026785 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2e2730c9-8471-4f1a-bc42-14192a54f141 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:58.030065 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2e2730c9-8471-4f1a-bc42-14192a54f141 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.500029 Sep 03 01:35:58.032943 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 231/470] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:57 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:58.616303 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-875dba95-1e92-47da-90ef-c3e616e9f0cd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:58.636236 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-875dba95-1e92-47da-90ef-c3e616e9f0cd tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.686803 Sep 03 01:35:58.651636 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 240/471] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:57 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:35:59.065142 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-092fc497-af18-4c56-bc43-01fc7f4afa63 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:59.067145 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-092fc497-af18-4c56-bc43-01fc7f4afa63 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:59.085232 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-092fc497-af18-4c56-bc43-01fc7f4afa63 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:59.086056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-092fc497-af18-4c56-bc43-01fc7f4afa63 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:59.086730 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-092fc497-af18-4c56-bc43-01fc7f4afa63 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:59.087641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-092fc497-af18-4c56-bc43-01fc7f4afa63 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:59.088270 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-092fc497-af18-4c56-bc43-01fc7f4afa63 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:59.088883 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-092fc497-af18-4c56-bc43-01fc7f4afa63 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:59.388195 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-092fc497-af18-4c56-bc43-01fc7f4afa63 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:59.414900 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-092fc497-af18-4c56-bc43-01fc7f4afa63 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:59.417986 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-092fc497-af18-4c56-bc43-01fc7f4afa63 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:35:59.419526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-092fc497-af18-4c56-bc43-01fc7f4afa63 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.358355 Sep 03 01:35:59.420708 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 232/472] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:35:59 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:35:59.669257 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-be727154-86e5-48c5-b552-b9fb074d0edf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:35:59.669699 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-be727154-86e5-48c5-b552-b9fb074d0edf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:35:59.687587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-be727154-86e5-48c5-b552-b9fb074d0edf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:59.689617 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-be727154-86e5-48c5-b552-b9fb074d0edf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:59.692191 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-be727154-86e5-48c5-b552-b9fb074d0edf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:35:59.697695 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-be727154-86e5-48c5-b552-b9fb074d0edf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:35:59.698430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-be727154-86e5-48c5-b552-b9fb074d0edf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:35:59.703108 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-be727154-86e5-48c5-b552-b9fb074d0edf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:00.250776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-be727154-86e5-48c5-b552-b9fb074d0edf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:00.278047 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-be727154-86e5-48c5-b552-b9fb074d0edf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1725 microversion: 2.1 time: 0.612612 Sep 03 01:36:00.280482 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 241/473] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:35:59 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1725 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:00.460043 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-62c33b40-2fdb-4b26-a77f-3f242193873f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:00.460824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-62c33b40-2fdb-4b26-a77f-3f242193873f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:00.484232 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62c33b40-2fdb-4b26-a77f-3f242193873f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:00.485890 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62c33b40-2fdb-4b26-a77f-3f242193873f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:00.489176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62c33b40-2fdb-4b26-a77f-3f242193873f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:00.490104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62c33b40-2fdb-4b26-a77f-3f242193873f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:00.490762 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62c33b40-2fdb-4b26-a77f-3f242193873f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:00.493635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62c33b40-2fdb-4b26-a77f-3f242193873f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:00.682946 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-62c33b40-2fdb-4b26-a77f-3f242193873f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:00.700140 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-62c33b40-2fdb-4b26-a77f-3f242193873f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:00.703831 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-62c33b40-2fdb-4b26-a77f-3f242193873f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:00.705652 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-62c33b40-2fdb-4b26-a77f-3f242193873f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.263242 Sep 03 01:36:00.707314 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 233/474] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:00 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:01.152962 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-896c6bd9-582a-41d2-ae4d-2714f18eea24 req-f894d3d1-53cc-4506-830d-acc9c0e4f1ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0cc53030-cbc9-48c7-8b91-8e23455b23b8", "tag": "d96cd46a-c8f7-49a5-bfb9-dda260e9c70a"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:01.169123 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-896c6bd9-582a-41d2-ae4d-2714f18eea24 req-f894d3d1-53cc-4506-830d-acc9c0e4f1ea service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:01.170819 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-896c6bd9-582a-41d2-ae4d-2714f18eea24 req-f894d3d1-53cc-4506-830d-acc9c0e4f1ea service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:01.173488 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-896c6bd9-582a-41d2-ae4d-2714f18eea24 req-f894d3d1-53cc-4506-830d-acc9c0e4f1ea service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:01.193137 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-896c6bd9-582a-41d2-ae4d-2714f18eea24 req-f894d3d1-53cc-4506-830d-acc9c0e4f1ea service nova] Creating event network-changed:d96cd46a-c8f7-49a5-bfb9-dda260e9c70a for instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 on hv-cinder-83800 Sep 03 01:36:01.210757 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-896c6bd9-582a-41d2-ae4d-2714f18eea24 req-f894d3d1-53cc-4506-830d-acc9c0e4f1ea service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067836 Sep 03 01:36:01.216705 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 242/475] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:36:01.308427 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c0a2c75e-04a3-405d-a35f-ca3f156cae6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:01.309047 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c0a2c75e-04a3-405d-a35f-ca3f156cae6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:01.320030 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0a2c75e-04a3-405d-a35f-ca3f156cae6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:01.322664 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0a2c75e-04a3-405d-a35f-ca3f156cae6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:01.325665 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0a2c75e-04a3-405d-a35f-ca3f156cae6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:01.326802 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0a2c75e-04a3-405d-a35f-ca3f156cae6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:01.327424 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0a2c75e-04a3-405d-a35f-ca3f156cae6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:01.329278 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0a2c75e-04a3-405d-a35f-ca3f156cae6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:01.624738 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c0a2c75e-04a3-405d-a35f-ca3f156cae6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:01.640302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c0a2c75e-04a3-405d-a35f-ca3f156cae6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1702 microversion: 2.1 time: 0.332913 Sep 03 01:36:01.657061 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 234/476] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:01 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1702 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:01.674313 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-dd45fbe3-777d-45aa-9932-89f6d7b93a9e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:01.691888 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd45fbe3-777d-45aa-9932-89f6d7b93a9e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:01.696963 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd45fbe3-777d-45aa-9932-89f6d7b93a9e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:01.697629 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd45fbe3-777d-45aa-9932-89f6d7b93a9e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:01.733326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-38531e6c-aa7e-4390-b4ef-fae226c77e1f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:01.734775 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-38531e6c-aa7e-4390-b4ef-fae226c77e1f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:01.747915 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-38531e6c-aa7e-4390-b4ef-fae226c77e1f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:01.761468 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-38531e6c-aa7e-4390-b4ef-fae226c77e1f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:01.761468 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-38531e6c-aa7e-4390-b4ef-fae226c77e1f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:01.770378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-38531e6c-aa7e-4390-b4ef-fae226c77e1f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:01.771148 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-38531e6c-aa7e-4390-b4ef-fae226c77e1f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:01.772514 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-38531e6c-aa7e-4390-b4ef-fae226c77e1f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:01.817910 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-dd45fbe3-777d-45aa-9932-89f6d7b93a9e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Going to try to start instance {{(pid=127552) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 03 01:36:02.171207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-dd45fbe3-777d-45aa-9932-89f6d7b93a9e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "POST /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/action" status: 202 len: 0 microversion: 2.1 time: 0.505889 Sep 03 01:36:02.178527 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 243/477] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:36:01 2022] POST /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:36:02.185071 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-38531e6c-aa7e-4390-b4ef-fae226c77e1f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:02.199026 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-38531e6c-aa7e-4390-b4ef-fae226c77e1f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:02.200484 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e6b398ad-8691-4643-adf9-266484b49d35 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:02.202545 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e6b398ad-8691-4643-adf9-266484b49d35 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:02.204050 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-38531e6c-aa7e-4390-b4ef-fae226c77e1f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:02.206898 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-38531e6c-aa7e-4390-b4ef-fae226c77e1f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.477443 Sep 03 01:36:02.210034 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 235/478] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:01 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:02.228748 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6b398ad-8691-4643-adf9-266484b49d35 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:02.229668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6b398ad-8691-4643-adf9-266484b49d35 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:02.232926 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6b398ad-8691-4643-adf9-266484b49d35 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:02.236168 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6b398ad-8691-4643-adf9-266484b49d35 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:02.238364 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6b398ad-8691-4643-adf9-266484b49d35 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:02.239101 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6b398ad-8691-4643-adf9-266484b49d35 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:03.209173 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e6b398ad-8691-4643-adf9-266484b49d35 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:03.240674 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e6b398ad-8691-4643-adf9-266484b49d35 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1711 microversion: 2.1 time: 1.058317 Sep 03 01:36:03.243220 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b88e140e-fea3-4966-99fa-07dd7aea1488 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:03.243963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b88e140e-fea3-4966-99fa-07dd7aea1488 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:03.244322 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 244/479] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:02 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1711 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:03.272460 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b88e140e-fea3-4966-99fa-07dd7aea1488 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:03.279002 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b88e140e-fea3-4966-99fa-07dd7aea1488 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:03.279596 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b88e140e-fea3-4966-99fa-07dd7aea1488 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:03.280422 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b88e140e-fea3-4966-99fa-07dd7aea1488 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:03.280907 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b88e140e-fea3-4966-99fa-07dd7aea1488 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:03.281821 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b88e140e-fea3-4966-99fa-07dd7aea1488 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:03.490233 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b88e140e-fea3-4966-99fa-07dd7aea1488 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:03.501404 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b88e140e-fea3-4966-99fa-07dd7aea1488 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:03.505281 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b88e140e-fea3-4966-99fa-07dd7aea1488 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:03.507585 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b88e140e-fea3-4966-99fa-07dd7aea1488 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.270093 Sep 03 01:36:03.508166 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 236/480] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:03 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:36:04.271481 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9f94e657-829a-4cfb-8bf2-91ca9f73dbeb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:04.272094 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9f94e657-829a-4cfb-8bf2-91ca9f73dbeb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:04.278009 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9f94e657-829a-4cfb-8bf2-91ca9f73dbeb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:04.278553 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9f94e657-829a-4cfb-8bf2-91ca9f73dbeb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:04.279043 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9f94e657-829a-4cfb-8bf2-91ca9f73dbeb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:04.279734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9f94e657-829a-4cfb-8bf2-91ca9f73dbeb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:04.280191 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9f94e657-829a-4cfb-8bf2-91ca9f73dbeb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:04.280620 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9f94e657-829a-4cfb-8bf2-91ca9f73dbeb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:04.516399 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9f94e657-829a-4cfb-8bf2-91ca9f73dbeb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:04.539031 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-46c2bfa5-7a16-471d-a6af-cf045f953d2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:04.539886 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9f94e657-829a-4cfb-8bf2-91ca9f73dbeb tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1711 microversion: 2.1 time: 0.270819 Sep 03 01:36:04.540365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-46c2bfa5-7a16-471d-a6af-cf045f953d2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:04.547590 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-46c2bfa5-7a16-471d-a6af-cf045f953d2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:04.548319 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-46c2bfa5-7a16-471d-a6af-cf045f953d2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:04.548923 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-46c2bfa5-7a16-471d-a6af-cf045f953d2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:04.549923 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-46c2bfa5-7a16-471d-a6af-cf045f953d2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:04.554967 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-46c2bfa5-7a16-471d-a6af-cf045f953d2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:04.555259 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 245/481] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:04 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1711 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:04.555983 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-46c2bfa5-7a16-471d-a6af-cf045f953d2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:04.797610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-46c2bfa5-7a16-471d-a6af-cf045f953d2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:04.813814 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-46c2bfa5-7a16-471d-a6af-cf045f953d2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:04.813814 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-46c2bfa5-7a16-471d-a6af-cf045f953d2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:04.813814 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-46c2bfa5-7a16-471d-a6af-cf045f953d2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.277455 Sep 03 01:36:04.814775 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 237/482] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:04 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:05.577363 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-608a9c4d-8f97-4647-8f21-3cf94d549d57 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Action: 'create', calling method: .version_select at 0x7f6d24a22f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-2015649541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuZ5IQH+IOzySCw4qDElHblSjel9vlV/ama5sZbYm5MLeBCf5j6O2vSFc7muEPs9v901pE8hefWqU9ni+jLJopbv1+NB6KoY+NpriVKvM8QbDO8RXNHIJWpp+J2jXwqCQ=="}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:05.582596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-efcfdbdb-bddd-484b-bd8e-e2c28dc80391 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:05.583887 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-efcfdbdb-bddd-484b-bd8e-e2c28dc80391 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:05.598611 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-efcfdbdb-bddd-484b-bd8e-e2c28dc80391 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:05.600148 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-efcfdbdb-bddd-484b-bd8e-e2c28dc80391 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:05.601090 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-efcfdbdb-bddd-484b-bd8e-e2c28dc80391 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:05.603807 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-efcfdbdb-bddd-484b-bd8e-e2c28dc80391 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:05.604491 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-efcfdbdb-bddd-484b-bd8e-e2c28dc80391 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:05.606475 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-efcfdbdb-bddd-484b-bd8e-e2c28dc80391 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:05.627366 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-608a9c4d-8f97-4647-8f21-3cf94d549d57 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Getting quotas for project 364812df6abf492698453972e9a1d120. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:36:05.639629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-608a9c4d-8f97-4647-8f21-3cf94d549d57 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Getting quotas for user b8349bd45ad84f14858f73bf42b48380 and project 364812df6abf492698453972e9a1d120. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:36:05.793402 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-608a9c4d-8f97-4647-8f21-3cf94d549d57 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.206625 Sep 03 01:36:05.793402 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 238/483] 10.222.0.13 () {60 vars in 1159 bytes} [Sat Sep 3 01:36:05 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:36:05.845086 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6219ae7f-7927-4571-9fdc-5660a7189788 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:05.845702 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6219ae7f-7927-4571-9fdc-5660a7189788 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:05.860328 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6219ae7f-7927-4571-9fdc-5660a7189788 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:05.860831 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6219ae7f-7927-4571-9fdc-5660a7189788 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:05.861272 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6219ae7f-7927-4571-9fdc-5660a7189788 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:05.862325 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-efcfdbdb-bddd-484b-bd8e-e2c28dc80391 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:05.862865 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6219ae7f-7927-4571-9fdc-5660a7189788 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:05.863389 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6219ae7f-7927-4571-9fdc-5660a7189788 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:05.863767 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6219ae7f-7927-4571-9fdc-5660a7189788 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:05.874637 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-efcfdbdb-bddd-484b-bd8e-e2c28dc80391 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1715 microversion: 2.1 time: 0.311420 Sep 03 01:36:05.890474 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 246/484] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:05 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1715 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:05.985908 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-144862597", "imageRef": "3a303356-7cb7-485e-a5d1-07dd7209ba7a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-2015649541", "networks": [{"uuid": "c2c48c52-ba15-4f2e-b132-5ab71bb2bb99"}]}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:06.095783 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6219ae7f-7927-4571-9fdc-5660a7189788 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:06.109894 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6219ae7f-7927-4571-9fdc-5660a7189788 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:06.112683 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6219ae7f-7927-4571-9fdc-5660a7189788 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:06.114529 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6219ae7f-7927-4571-9fdc-5660a7189788 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.273306 Sep 03 01:36:06.127258 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 239/485] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:05 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:36:07.157244 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9e77ee7b-9ff1-40ba-a131-03ab415fe4b8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:07.157244 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9e77ee7b-9ff1-40ba-a131-03ab415fe4b8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:07.157244 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e77ee7b-9ff1-40ba-a131-03ab415fe4b8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:07.157244 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e77ee7b-9ff1-40ba-a131-03ab415fe4b8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:07.158267 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e77ee7b-9ff1-40ba-a131-03ab415fe4b8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:07.158267 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e77ee7b-9ff1-40ba-a131-03ab415fe4b8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:07.158267 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e77ee7b-9ff1-40ba-a131-03ab415fe4b8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:07.158267 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e77ee7b-9ff1-40ba-a131-03ab415fe4b8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:07.317585 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9e77ee7b-9ff1-40ba-a131-03ab415fe4b8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:07.325868 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9e77ee7b-9ff1-40ba-a131-03ab415fe4b8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:07.327322 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9e77ee7b-9ff1-40ba-a131-03ab415fe4b8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:07.328463 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9e77ee7b-9ff1-40ba-a131-03ab415fe4b8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.189043 Sep 03 01:36:07.329018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 240/486] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:07 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:36:07.884003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.network.neutron [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] validate_networks() for [('c2c48c52-ba15-4f2e-b132-5ab71bb2bb99', None, None, None, None, None)] {{(pid=127552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:36:08.353548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7f39acf5-8cf6-4186-b09d-259c8e005fb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:08.354317 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7f39acf5-8cf6-4186-b09d-259c8e005fb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:08.369043 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f39acf5-8cf6-4186-b09d-259c8e005fb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:08.371640 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f39acf5-8cf6-4186-b09d-259c8e005fb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:08.375741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f39acf5-8cf6-4186-b09d-259c8e005fb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:08.376761 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f39acf5-8cf6-4186-b09d-259c8e005fb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:08.377497 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f39acf5-8cf6-4186-b09d-259c8e005fb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:08.378135 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f39acf5-8cf6-4186-b09d-259c8e005fb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:08.392767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Flavor limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:36:08.393191 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Image limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:36:08.393659 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Flavor pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:36:08.394408 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Image pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:36:08.395793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:36:08.409667 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:08.410521 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:08.412093 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:08.413046 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:08.413682 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:08.414276 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:08.432876 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Getting quotas for project 364812df6abf492698453972e9a1d120. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:36:08.437074 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Getting quotas for user b8349bd45ad84f14858f73bf42b48380 and project 364812df6abf492698453972e9a1d120. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:36:08.450013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Going to run 1 instances... {{(pid=127552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:36:08.452557 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='3a303356-7cb7-485e-a5d1-07dd7209ba7a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:36:08.579545 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7f39acf5-8cf6-4186-b09d-259c8e005fb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:08.589501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7f39acf5-8cf6-4186-b09d-259c8e005fb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:08.590967 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7f39acf5-8cf6-4186-b09d-259c8e005fb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:08.603584 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7f39acf5-8cf6-4186-b09d-259c8e005fb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.242476 Sep 03 01:36:08.603584 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 241/487] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:08 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:08.638912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-12b957f0-3a3c-41da-8f3b-fc3f38b5ffe1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.657132 Sep 03 01:36:08.639562 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 247/488] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:36:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 2660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:36:08.651469 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b0314215-0cdf-44bb-a45c-ed82126506c6 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:08.652169 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b0314215-0cdf-44bb-a45c-ed82126506c6 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:08.733687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b0314215-0cdf-44bb-a45c-ed82126506c6 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:08.743736 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b0314215-0cdf-44bb-a45c-ed82126506c6 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1258 microversion: 2.1 time: 0.096157 Sep 03 01:36:08.744811 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 242/489] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:08 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1258 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:09.624947 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ee3b6481-ca64-4e22-a879-cd2a7425bdb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:09.626215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ee3b6481-ca64-4e22-a879-cd2a7425bdb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:09.634108 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ee3b6481-ca64-4e22-a879-cd2a7425bdb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:09.634720 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ee3b6481-ca64-4e22-a879-cd2a7425bdb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:09.635383 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ee3b6481-ca64-4e22-a879-cd2a7425bdb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:09.636155 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ee3b6481-ca64-4e22-a879-cd2a7425bdb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:09.636670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ee3b6481-ca64-4e22-a879-cd2a7425bdb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:09.637473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ee3b6481-ca64-4e22-a879-cd2a7425bdb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:09.776608 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-acfec58d-ddf7-4f8c-b278-a79dc175e743 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:09.777333 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-acfec58d-ddf7-4f8c-b278-a79dc175e743 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:09.804576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ee3b6481-ca64-4e22-a879-cd2a7425bdb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:09.807079 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-acfec58d-ddf7-4f8c-b278-a79dc175e743 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:09.808687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-acfec58d-ddf7-4f8c-b278-a79dc175e743 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:09.812543 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:09.815021 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-acfec58d-ddf7-4f8c-b278-a79dc175e743 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:09.820279 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-acfec58d-ddf7-4f8c-b278-a79dc175e743 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:09.820991 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-acfec58d-ddf7-4f8c-b278-a79dc175e743 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:09.823185 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-acfec58d-ddf7-4f8c-b278-a79dc175e743 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:09.829776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ee3b6481-ca64-4e22-a879-cd2a7425bdb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:09.834655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ee3b6481-ca64-4e22-a879-cd2a7425bdb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:09.836000 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ee3b6481-ca64-4e22-a879-cd2a7425bdb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.216648 Sep 03 01:36:09.836672 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 248/490] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:09 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:09.919752 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-acfec58d-ddf7-4f8c-b278-a79dc175e743 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:09.929319 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-acfec58d-ddf7-4f8c-b278-a79dc175e743 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1262 microversion: 2.1 time: 0.164102 Sep 03 01:36:09.940984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 243/491] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:09 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1262 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:10.868167 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-76ae3564-3398-4ccf-86ec-66fd2c300eff tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:10.868727 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-76ae3564-3398-4ccf-86ec-66fd2c300eff tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:10.874973 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76ae3564-3398-4ccf-86ec-66fd2c300eff tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:10.875456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76ae3564-3398-4ccf-86ec-66fd2c300eff tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:10.875895 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76ae3564-3398-4ccf-86ec-66fd2c300eff tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:10.876590 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76ae3564-3398-4ccf-86ec-66fd2c300eff tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:10.877099 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76ae3564-3398-4ccf-86ec-66fd2c300eff tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:10.877526 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-76ae3564-3398-4ccf-86ec-66fd2c300eff tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:10.953354 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ab9c4839-eafb-4fdf-92b4-c46cd353df87 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:10.954048 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ab9c4839-eafb-4fdf-92b4-c46cd353df87 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:10.961158 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ab9c4839-eafb-4fdf-92b4-c46cd353df87 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:10.961717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ab9c4839-eafb-4fdf-92b4-c46cd353df87 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:10.962219 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ab9c4839-eafb-4fdf-92b4-c46cd353df87 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:10.963064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ab9c4839-eafb-4fdf-92b4-c46cd353df87 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:10.963585 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ab9c4839-eafb-4fdf-92b4-c46cd353df87 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:10.964081 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ab9c4839-eafb-4fdf-92b4-c46cd353df87 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:11.016146 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-76ae3564-3398-4ccf-86ec-66fd2c300eff tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:11.025286 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-76ae3564-3398-4ccf-86ec-66fd2c300eff tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:11.026775 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-76ae3564-3398-4ccf-86ec-66fd2c300eff tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:11.028192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-76ae3564-3398-4ccf-86ec-66fd2c300eff tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.165007 Sep 03 01:36:11.028497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 249/492] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:10 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:11.030955 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ab9c4839-eafb-4fdf-92b4-c46cd353df87 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:11.038500 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ab9c4839-eafb-4fdf-92b4-c46cd353df87 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1310 microversion: 2.1 time: 0.089070 Sep 03 01:36:11.038946 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 244/493] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:10 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1310 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:12.055142 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2356b60e-d2b4-4bad-b148-1c8fdee098a1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:12.056415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2356b60e-d2b4-4bad-b148-1c8fdee098a1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:12.058529 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:12.066283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1d6d9887-aada-40e0-aa2e-c068a59c9b6d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:12.067731 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1d6d9887-aada-40e0-aa2e-c068a59c9b6d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:12.078080 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d6d9887-aada-40e0-aa2e-c068a59c9b6d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:12.079816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d6d9887-aada-40e0-aa2e-c068a59c9b6d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:12.081258 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d6d9887-aada-40e0-aa2e-c068a59c9b6d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:12.082146 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2356b60e-d2b4-4bad-b148-1c8fdee098a1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:12.083563 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d6d9887-aada-40e0-aa2e-c068a59c9b6d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:12.084335 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2356b60e-d2b4-4bad-b148-1c8fdee098a1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:12.085160 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2356b60e-d2b4-4bad-b148-1c8fdee098a1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:12.086596 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d6d9887-aada-40e0-aa2e-c068a59c9b6d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:12.087437 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d6d9887-aada-40e0-aa2e-c068a59c9b6d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:12.087888 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2356b60e-d2b4-4bad-b148-1c8fdee098a1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:12.090931 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2356b60e-d2b4-4bad-b148-1c8fdee098a1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:12.091942 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2356b60e-d2b4-4bad-b148-1c8fdee098a1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:12.263336 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1d6d9887-aada-40e0-aa2e-c068a59c9b6d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:12.280044 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1d6d9887-aada-40e0-aa2e-c068a59c9b6d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1316 microversion: 2.1 time: 0.217281 Sep 03 01:36:12.281989 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 245/494] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:12 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:12.548511 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2356b60e-d2b4-4bad-b148-1c8fdee098a1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:12.564004 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2356b60e-d2b4-4bad-b148-1c8fdee098a1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:12.566067 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2356b60e-d2b4-4bad-b148-1c8fdee098a1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:12.570653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2356b60e-d2b4-4bad-b148-1c8fdee098a1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.519071 Sep 03 01:36:12.572005 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 250/495] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:12 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:13.080465 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-aaf2e06b-dd88-48c5-b961-1321bdf7c646 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd3cadc2-09f0-44f4-a795-81470d7fe18c"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:13.086073 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-aaf2e06b-dd88-48c5-b961-1321bdf7c646 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:13.112110 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aaf2e06b-dd88-48c5-b961-1321bdf7c646 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:13.112606 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aaf2e06b-dd88-48c5-b961-1321bdf7c646 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:13.113049 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aaf2e06b-dd88-48c5-b961-1321bdf7c646 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:13.113801 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aaf2e06b-dd88-48c5-b961-1321bdf7c646 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:13.114283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aaf2e06b-dd88-48c5-b961-1321bdf7c646 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:13.114846 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aaf2e06b-dd88-48c5-b961-1321bdf7c646 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:13.306680 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a8e0f2d7-4a1c-4f10-82fe-2c790f81165a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:13.308025 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a8e0f2d7-4a1c-4f10-82fe-2c790f81165a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:13.318861 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a8e0f2d7-4a1c-4f10-82fe-2c790f81165a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:13.319355 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a8e0f2d7-4a1c-4f10-82fe-2c790f81165a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:13.319970 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a8e0f2d7-4a1c-4f10-82fe-2c790f81165a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:13.320841 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a8e0f2d7-4a1c-4f10-82fe-2c790f81165a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:13.323007 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a8e0f2d7-4a1c-4f10-82fe-2c790f81165a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:13.323632 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a8e0f2d7-4a1c-4f10-82fe-2c790f81165a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:13.943024 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a8e0f2d7-4a1c-4f10-82fe-2c790f81165a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:13.976315 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a8e0f2d7-4a1c-4f10-82fe-2c790f81165a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.673224 Sep 03 01:36:14.002884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 251/496] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:13 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:36:14.015136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cf2eabf2-cf7e-4548-b16c-a88bf5aab298 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:14.015735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cf2eabf2-cf7e-4548-b16c-a88bf5aab298 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:14.034233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf2eabf2-cf7e-4548-b16c-a88bf5aab298 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:14.039186 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf2eabf2-cf7e-4548-b16c-a88bf5aab298 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:14.039860 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf2eabf2-cf7e-4548-b16c-a88bf5aab298 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:14.041166 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf2eabf2-cf7e-4548-b16c-a88bf5aab298 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:14.041839 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf2eabf2-cf7e-4548-b16c-a88bf5aab298 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:14.042493 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf2eabf2-cf7e-4548-b16c-a88bf5aab298 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:14.661923 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cf2eabf2-cf7e-4548-b16c-a88bf5aab298 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:14.673971 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cf2eabf2-cf7e-4548-b16c-a88bf5aab298 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:14.677289 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cf2eabf2-cf7e-4548-b16c-a88bf5aab298 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:14.683005 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cf2eabf2-cf7e-4548-b16c-a88bf5aab298 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.671184 Sep 03 01:36:14.694133 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 252/497] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:14 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:14.923920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-aaf2e06b-dd88-48c5-b961-1321bdf7c646 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "POST /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.841762 Sep 03 01:36:14.923920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 246/498] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:36:13 2022] POST /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments => generated 194 bytes in 1844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:36:15.019984 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-4a974409-8e1e-4d36-9ea8-97df485dca0d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:15.021887 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-4a974409-8e1e-4d36-9ea8-97df485dca0d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:15.032114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4a974409-8e1e-4d36-9ea8-97df485dca0d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:15.033534 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4a974409-8e1e-4d36-9ea8-97df485dca0d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:15.034562 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4a974409-8e1e-4d36-9ea8-97df485dca0d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:15.036697 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4a974409-8e1e-4d36-9ea8-97df485dca0d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:15.037524 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4a974409-8e1e-4d36-9ea8-97df485dca0d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:15.038690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4a974409-8e1e-4d36-9ea8-97df485dca0d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:15.354618 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-4a974409-8e1e-4d36-9ea8-97df485dca0d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:15.362115 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-4a974409-8e1e-4d36-9ea8-97df485dca0d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.349334 Sep 03 01:36:15.362719 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 253/499] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:15 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:15.675410 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-337955b6-743c-4288-af37-96916a11ccf8 req-c214a01b-36d7-49ea-ad6e-98fe11a8f3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5df2d41-c884-4178-9a70-150c16cf1c5f", "tag": "f1b93106-790d-4f9d-9fae-cd59eef8bc20"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:15.690510 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-337955b6-743c-4288-af37-96916a11ccf8 req-c214a01b-36d7-49ea-ad6e-98fe11a8f3b3 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:15.692271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-337955b6-743c-4288-af37-96916a11ccf8 req-c214a01b-36d7-49ea-ad6e-98fe11a8f3b3 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:15.692890 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-337955b6-743c-4288-af37-96916a11ccf8 req-c214a01b-36d7-49ea-ad6e-98fe11a8f3b3 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:15.710383 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-337955b6-743c-4288-af37-96916a11ccf8 req-c214a01b-36d7-49ea-ad6e-98fe11a8f3b3 service nova] Creating event network-changed:f1b93106-790d-4f9d-9fae-cd59eef8bc20 for instance e5df2d41-c884-4178-9a70-150c16cf1c5f on hv-cinder-83800 Sep 03 01:36:15.715821 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-337955b6-743c-4288-af37-96916a11ccf8 req-c214a01b-36d7-49ea-ad6e-98fe11a8f3b3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044743 Sep 03 01:36:15.719390 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 247/500] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:36:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:36:15.731637 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-22d7e5b2-144b-4eb5-8769-b8194217ef80 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:15.731637 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-22d7e5b2-144b-4eb5-8769-b8194217ef80 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:15.736502 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22d7e5b2-144b-4eb5-8769-b8194217ef80 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:15.737300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22d7e5b2-144b-4eb5-8769-b8194217ef80 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:15.737954 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22d7e5b2-144b-4eb5-8769-b8194217ef80 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:15.739695 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22d7e5b2-144b-4eb5-8769-b8194217ef80 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:15.740967 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22d7e5b2-144b-4eb5-8769-b8194217ef80 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:15.742393 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22d7e5b2-144b-4eb5-8769-b8194217ef80 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:16.223184 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-22d7e5b2-144b-4eb5-8769-b8194217ef80 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:16.258186 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-22d7e5b2-144b-4eb5-8769-b8194217ef80 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:16.260442 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-22d7e5b2-144b-4eb5-8769-b8194217ef80 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:16.262065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-22d7e5b2-144b-4eb5-8769-b8194217ef80 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.543243 Sep 03 01:36:16.270423 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 254/501] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:15 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:16.389829 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-229c00d6-4c7f-4888-9dff-3d06889e1922 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:16.389829 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-229c00d6-4c7f-4888-9dff-3d06889e1922 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:16.399225 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-229c00d6-4c7f-4888-9dff-3d06889e1922 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:16.399860 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-229c00d6-4c7f-4888-9dff-3d06889e1922 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:16.404321 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-229c00d6-4c7f-4888-9dff-3d06889e1922 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:16.405401 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-229c00d6-4c7f-4888-9dff-3d06889e1922 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:16.406020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-229c00d6-4c7f-4888-9dff-3d06889e1922 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:16.406885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-229c00d6-4c7f-4888-9dff-3d06889e1922 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:16.641354 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-229c00d6-4c7f-4888-9dff-3d06889e1922 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:16.649792 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:16.660973 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-229c00d6-4c7f-4888-9dff-3d06889e1922 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.278779 Sep 03 01:36:16.661583 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 248/502] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:16 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:17.295318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-79380504-d330-4721-8f31-16adbc90369f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:17.295994 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-79380504-d330-4721-8f31-16adbc90369f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:17.308146 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79380504-d330-4721-8f31-16adbc90369f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:17.311114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79380504-d330-4721-8f31-16adbc90369f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:17.311114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79380504-d330-4721-8f31-16adbc90369f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:17.311114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79380504-d330-4721-8f31-16adbc90369f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:17.311114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79380504-d330-4721-8f31-16adbc90369f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:17.311451 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79380504-d330-4721-8f31-16adbc90369f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:17.584059 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-79380504-d330-4721-8f31-16adbc90369f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:17.601051 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-79380504-d330-4721-8f31-16adbc90369f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:17.607435 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-79380504-d330-4721-8f31-16adbc90369f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:17.610383 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-79380504-d330-4721-8f31-16adbc90369f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.322083 Sep 03 01:36:17.619103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 255/503] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:17 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:17.690824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-75630842-7e46-4330-aae5-b781df698da7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:17.693628 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-75630842-7e46-4330-aae5-b781df698da7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:17.723128 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-75630842-7e46-4330-aae5-b781df698da7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:17.731642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-75630842-7e46-4330-aae5-b781df698da7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:17.731642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-75630842-7e46-4330-aae5-b781df698da7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:17.731642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-75630842-7e46-4330-aae5-b781df698da7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:17.731642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-75630842-7e46-4330-aae5-b781df698da7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:17.732393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-75630842-7e46-4330-aae5-b781df698da7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:18.029418 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-75630842-7e46-4330-aae5-b781df698da7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:18.050172 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-75630842-7e46-4330-aae5-b781df698da7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.367574 Sep 03 01:36:18.051808 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 249/504] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:17 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:18.665506 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a6fbb21c-7596-4bb4-8982-0691cd028355 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:18.666206 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a6fbb21c-7596-4bb4-8982-0691cd028355 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:18.668277 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:18.668959 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=6 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:18.677392 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a6fbb21c-7596-4bb4-8982-0691cd028355 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:18.677392 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a6fbb21c-7596-4bb4-8982-0691cd028355 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:18.677392 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a6fbb21c-7596-4bb4-8982-0691cd028355 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:18.677392 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a6fbb21c-7596-4bb4-8982-0691cd028355 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:18.677821 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a6fbb21c-7596-4bb4-8982-0691cd028355 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:18.677821 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a6fbb21c-7596-4bb4-8982-0691cd028355 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:18.876641 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a6fbb21c-7596-4bb4-8982-0691cd028355 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:18.891488 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a6fbb21c-7596-4bb4-8982-0691cd028355 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:18.903452 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a6fbb21c-7596-4bb4-8982-0691cd028355 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:18.904768 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a6fbb21c-7596-4bb4-8982-0691cd028355 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.259111 Sep 03 01:36:18.905379 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 256/505] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:18 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:19.074792 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b30733b8-aa20-43ff-98a9-9ee0054f7835 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:19.075991 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b30733b8-aa20-43ff-98a9-9ee0054f7835 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:19.083517 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=6 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:19.086022 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b30733b8-aa20-43ff-98a9-9ee0054f7835 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:19.086697 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b30733b8-aa20-43ff-98a9-9ee0054f7835 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:19.087289 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b30733b8-aa20-43ff-98a9-9ee0054f7835 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:19.088170 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b30733b8-aa20-43ff-98a9-9ee0054f7835 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:19.088777 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b30733b8-aa20-43ff-98a9-9ee0054f7835 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:19.089495 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b30733b8-aa20-43ff-98a9-9ee0054f7835 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:19.327730 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b30733b8-aa20-43ff-98a9-9ee0054f7835 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:19.337183 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b30733b8-aa20-43ff-98a9-9ee0054f7835 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.266268 Sep 03 01:36:19.338021 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 250/506] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:19 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:19.936985 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2b78b68b-9fbf-4a3f-93b3-79a06c3ec389 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:19.937598 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2b78b68b-9fbf-4a3f-93b3-79a06c3ec389 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:19.948217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2b78b68b-9fbf-4a3f-93b3-79a06c3ec389 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:19.949038 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2b78b68b-9fbf-4a3f-93b3-79a06c3ec389 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:19.949776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2b78b68b-9fbf-4a3f-93b3-79a06c3ec389 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:19.950745 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2b78b68b-9fbf-4a3f-93b3-79a06c3ec389 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:19.951654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2b78b68b-9fbf-4a3f-93b3-79a06c3ec389 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:19.952410 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2b78b68b-9fbf-4a3f-93b3-79a06c3ec389 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:20.127373 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2b78b68b-9fbf-4a3f-93b3-79a06c3ec389 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:20.137484 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2b78b68b-9fbf-4a3f-93b3-79a06c3ec389 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:20.138957 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2b78b68b-9fbf-4a3f-93b3-79a06c3ec389 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:20.140148 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2b78b68b-9fbf-4a3f-93b3-79a06c3ec389 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.207521 Sep 03 01:36:20.140882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 257/507] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:19 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:20.363776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4a9f2106-07cc-49ef-980f-5ed255114b13 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:20.365038 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4a9f2106-07cc-49ef-980f-5ed255114b13 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:20.372155 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a9f2106-07cc-49ef-980f-5ed255114b13 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:20.372648 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a9f2106-07cc-49ef-980f-5ed255114b13 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:20.373085 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a9f2106-07cc-49ef-980f-5ed255114b13 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:20.379829 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a9f2106-07cc-49ef-980f-5ed255114b13 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:20.391146 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a9f2106-07cc-49ef-980f-5ed255114b13 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:20.391594 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a9f2106-07cc-49ef-980f-5ed255114b13 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:20.658013 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4a9f2106-07cc-49ef-980f-5ed255114b13 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:20.666610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4a9f2106-07cc-49ef-980f-5ed255114b13 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.307617 Sep 03 01:36:20.667183 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 251/508] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:20 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:21.171851 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-20b42ba5-6e86-4a3a-8cb2-74357946e827 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:21.173298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-20b42ba5-6e86-4a3a-8cb2-74357946e827 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:21.180167 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-20b42ba5-6e86-4a3a-8cb2-74357946e827 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:21.180656 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-20b42ba5-6e86-4a3a-8cb2-74357946e827 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:21.181094 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-20b42ba5-6e86-4a3a-8cb2-74357946e827 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:21.182016 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-20b42ba5-6e86-4a3a-8cb2-74357946e827 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:21.182658 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-20b42ba5-6e86-4a3a-8cb2-74357946e827 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:21.183358 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-20b42ba5-6e86-4a3a-8cb2-74357946e827 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:21.331387 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-20b42ba5-6e86-4a3a-8cb2-74357946e827 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:21.346052 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-20b42ba5-6e86-4a3a-8cb2-74357946e827 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:21.348985 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-20b42ba5-6e86-4a3a-8cb2-74357946e827 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:21.350827 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-20b42ba5-6e86-4a3a-8cb2-74357946e827 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.183536 Sep 03 01:36:21.355455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 258/509] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:21 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:36:21.689598 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6f8c5261-2e75-4dab-9941-e98444ccb038 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:21.690851 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6f8c5261-2e75-4dab-9941-e98444ccb038 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:21.698086 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6f8c5261-2e75-4dab-9941-e98444ccb038 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:21.698596 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6f8c5261-2e75-4dab-9941-e98444ccb038 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:21.699036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6f8c5261-2e75-4dab-9941-e98444ccb038 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:21.699775 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6f8c5261-2e75-4dab-9941-e98444ccb038 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:21.700180 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6f8c5261-2e75-4dab-9941-e98444ccb038 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:21.700601 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6f8c5261-2e75-4dab-9941-e98444ccb038 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:21.902475 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6f8c5261-2e75-4dab-9941-e98444ccb038 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:21.919060 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6f8c5261-2e75-4dab-9941-e98444ccb038 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.233735 Sep 03 01:36:21.934517 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 252/510] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:21 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:22.381585 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c1de3c7a-dffe-4303-a3f5-1b87aa22e10d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:22.382213 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c1de3c7a-dffe-4303-a3f5-1b87aa22e10d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:22.389809 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c1de3c7a-dffe-4303-a3f5-1b87aa22e10d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:22.390620 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c1de3c7a-dffe-4303-a3f5-1b87aa22e10d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:22.391324 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c1de3c7a-dffe-4303-a3f5-1b87aa22e10d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:22.392207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c1de3c7a-dffe-4303-a3f5-1b87aa22e10d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:22.392652 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c1de3c7a-dffe-4303-a3f5-1b87aa22e10d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:22.393247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c1de3c7a-dffe-4303-a3f5-1b87aa22e10d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:22.550911 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c1de3c7a-dffe-4303-a3f5-1b87aa22e10d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:22.554432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c1de3c7a-dffe-4303-a3f5-1b87aa22e10d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:22.555844 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c1de3c7a-dffe-4303-a3f5-1b87aa22e10d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:22.557025 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c1de3c7a-dffe-4303-a3f5-1b87aa22e10d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.179646 Sep 03 01:36:22.564412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 259/511] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:22 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:22.948306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0086d334-ad7a-42f0-b634-a99bd03aa5ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:22.949609 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-0086d334-ad7a-42f0-b634-a99bd03aa5ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:22.958255 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0086d334-ad7a-42f0-b634-a99bd03aa5ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:22.958925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0086d334-ad7a-42f0-b634-a99bd03aa5ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:22.959589 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0086d334-ad7a-42f0-b634-a99bd03aa5ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:22.960369 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0086d334-ad7a-42f0-b634-a99bd03aa5ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:22.961189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0086d334-ad7a-42f0-b634-a99bd03aa5ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:22.961949 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0086d334-ad7a-42f0-b634-a99bd03aa5ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:23.121714 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-0086d334-ad7a-42f0-b634-a99bd03aa5ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:23.131542 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0086d334-ad7a-42f0-b634-a99bd03aa5ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.186628 Sep 03 01:36:23.132505 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 253/512] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:22 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:23.588365 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-98a93ecd-bede-49ac-a2fe-bbdbfdc05ec5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:23.589490 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-98a93ecd-bede-49ac-a2fe-bbdbfdc05ec5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:23.612362 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-98a93ecd-bede-49ac-a2fe-bbdbfdc05ec5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:23.614142 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-98a93ecd-bede-49ac-a2fe-bbdbfdc05ec5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:23.615229 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-98a93ecd-bede-49ac-a2fe-bbdbfdc05ec5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:23.616544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-98a93ecd-bede-49ac-a2fe-bbdbfdc05ec5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:23.617430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-98a93ecd-bede-49ac-a2fe-bbdbfdc05ec5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:23.618110 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-98a93ecd-bede-49ac-a2fe-bbdbfdc05ec5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:23.864278 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-98a93ecd-bede-49ac-a2fe-bbdbfdc05ec5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:23.882094 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-98a93ecd-bede-49ac-a2fe-bbdbfdc05ec5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:23.885747 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-98a93ecd-bede-49ac-a2fe-bbdbfdc05ec5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:23.889615 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-98a93ecd-bede-49ac-a2fe-bbdbfdc05ec5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.307291 Sep 03 01:36:23.891685 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 260/513] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:23 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:24.167487 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-92dbb781-a5d4-43a1-b701-17e980c8a3ff tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:24.207178 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-92dbb781-a5d4-43a1-b701-17e980c8a3ff tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:24.207178 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-92dbb781-a5d4-43a1-b701-17e980c8a3ff tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:24.207178 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-92dbb781-a5d4-43a1-b701-17e980c8a3ff tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:24.207178 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-92dbb781-a5d4-43a1-b701-17e980c8a3ff tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:24.209218 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-92dbb781-a5d4-43a1-b701-17e980c8a3ff tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:24.209218 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-92dbb781-a5d4-43a1-b701-17e980c8a3ff tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:24.209218 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-92dbb781-a5d4-43a1-b701-17e980c8a3ff tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:24.421834 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-92dbb781-a5d4-43a1-b701-17e980c8a3ff tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:24.433661 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-92dbb781-a5d4-43a1-b701-17e980c8a3ff tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.274826 Sep 03 01:36:24.433839 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 254/514] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:24 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:24.919691 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e0d6feb7-8ffb-40f2-9fe4-278de3b2f8c8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:24.920265 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e0d6feb7-8ffb-40f2-9fe4-278de3b2f8c8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:24.935790 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0d6feb7-8ffb-40f2-9fe4-278de3b2f8c8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:24.936317 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0d6feb7-8ffb-40f2-9fe4-278de3b2f8c8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:24.936823 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0d6feb7-8ffb-40f2-9fe4-278de3b2f8c8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:24.937478 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0d6feb7-8ffb-40f2-9fe4-278de3b2f8c8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:24.937929 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0d6feb7-8ffb-40f2-9fe4-278de3b2f8c8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:24.938630 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0d6feb7-8ffb-40f2-9fe4-278de3b2f8c8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:25.104090 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e0d6feb7-8ffb-40f2-9fe4-278de3b2f8c8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:25.114737 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e0d6feb7-8ffb-40f2-9fe4-278de3b2f8c8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:25.116456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e0d6feb7-8ffb-40f2-9fe4-278de3b2f8c8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:25.117982 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e0d6feb7-8ffb-40f2-9fe4-278de3b2f8c8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.202290 Sep 03 01:36:25.118573 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 261/515] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:24 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:25.466596 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5d771818-ae49-4ae5-9ab4-ed8eaf9b383e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:25.467313 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5d771818-ae49-4ae5-9ab4-ed8eaf9b383e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:25.475950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d771818-ae49-4ae5-9ab4-ed8eaf9b383e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:25.475950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d771818-ae49-4ae5-9ab4-ed8eaf9b383e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:25.475950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d771818-ae49-4ae5-9ab4-ed8eaf9b383e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:25.476600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d771818-ae49-4ae5-9ab4-ed8eaf9b383e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:25.477123 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d771818-ae49-4ae5-9ab4-ed8eaf9b383e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:25.477615 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d771818-ae49-4ae5-9ab4-ed8eaf9b383e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:25.642565 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5d771818-ae49-4ae5-9ab4-ed8eaf9b383e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:25.650916 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5d771818-ae49-4ae5-9ab4-ed8eaf9b383e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.188254 Sep 03 01:36:25.651493 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 255/516] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:25 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:26.142914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f839ce5a-922c-419f-9b90-5a3a716bf5f1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:26.144854 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f839ce5a-922c-419f-9b90-5a3a716bf5f1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:26.150389 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f839ce5a-922c-419f-9b90-5a3a716bf5f1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:26.150389 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f839ce5a-922c-419f-9b90-5a3a716bf5f1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:26.150789 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f839ce5a-922c-419f-9b90-5a3a716bf5f1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:26.151479 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f839ce5a-922c-419f-9b90-5a3a716bf5f1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:26.152000 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f839ce5a-922c-419f-9b90-5a3a716bf5f1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:26.152338 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f839ce5a-922c-419f-9b90-5a3a716bf5f1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:26.298525 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f839ce5a-922c-419f-9b90-5a3a716bf5f1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:26.307443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f839ce5a-922c-419f-9b90-5a3a716bf5f1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:26.308888 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f839ce5a-922c-419f-9b90-5a3a716bf5f1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:26.310044 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f839ce5a-922c-419f-9b90-5a3a716bf5f1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.171081 Sep 03 01:36:26.310650 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 262/517] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:26 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:26.678119 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cd4ecce8-f9ad-42bb-a803-7e4be8d4b0d2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:26.678906 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-cd4ecce8-f9ad-42bb-a803-7e4be8d4b0d2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:26.685935 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cd4ecce8-f9ad-42bb-a803-7e4be8d4b0d2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:26.686466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cd4ecce8-f9ad-42bb-a803-7e4be8d4b0d2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:26.686906 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cd4ecce8-f9ad-42bb-a803-7e4be8d4b0d2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:26.687625 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cd4ecce8-f9ad-42bb-a803-7e4be8d4b0d2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:26.688144 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cd4ecce8-f9ad-42bb-a803-7e4be8d4b0d2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:26.688601 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cd4ecce8-f9ad-42bb-a803-7e4be8d4b0d2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:26.840409 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cd4ecce8-f9ad-42bb-a803-7e4be8d4b0d2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:26.848619 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-cd4ecce8-f9ad-42bb-a803-7e4be8d4b0d2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.174679 Sep 03 01:36:26.852857 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 256/518] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:26 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:27.338803 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a055813a-63ff-4d30-99dc-53015f89b4d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:27.339377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a055813a-63ff-4d30-99dc-53015f89b4d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:27.345285 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a055813a-63ff-4d30-99dc-53015f89b4d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:27.345764 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a055813a-63ff-4d30-99dc-53015f89b4d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:27.346199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a055813a-63ff-4d30-99dc-53015f89b4d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:27.346912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a055813a-63ff-4d30-99dc-53015f89b4d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:27.347989 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a055813a-63ff-4d30-99dc-53015f89b4d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:27.348412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a055813a-63ff-4d30-99dc-53015f89b4d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:27.479942 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a055813a-63ff-4d30-99dc-53015f89b4d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:27.488349 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a055813a-63ff-4d30-99dc-53015f89b4d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:27.490878 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a055813a-63ff-4d30-99dc-53015f89b4d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:27.491174 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a055813a-63ff-4d30-99dc-53015f89b4d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.156276 Sep 03 01:36:27.491762 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 263/519] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:27 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:27.873251 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-3d8b5215-8e59-4390-84d9-50e6a901e84a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:27.873862 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-3d8b5215-8e59-4390-84d9-50e6a901e84a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:27.876435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:27.881641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3d8b5215-8e59-4390-84d9-50e6a901e84a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:27.882141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3d8b5215-8e59-4390-84d9-50e6a901e84a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:27.885884 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3d8b5215-8e59-4390-84d9-50e6a901e84a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:27.885884 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3d8b5215-8e59-4390-84d9-50e6a901e84a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:27.885884 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3d8b5215-8e59-4390-84d9-50e6a901e84a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:27.885884 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3d8b5215-8e59-4390-84d9-50e6a901e84a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:28.015499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-3d8b5215-8e59-4390-84d9-50e6a901e84a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:28.024121 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-3d8b5215-8e59-4390-84d9-50e6a901e84a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.154895 Sep 03 01:36:28.024689 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 257/520] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:27 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:28.517151 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e23530ab-959b-4a81-846d-d8994842a249 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:28.517746 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e23530ab-959b-4a81-846d-d8994842a249 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:28.523789 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e23530ab-959b-4a81-846d-d8994842a249 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:28.524278 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e23530ab-959b-4a81-846d-d8994842a249 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:28.524718 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e23530ab-959b-4a81-846d-d8994842a249 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:28.525408 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e23530ab-959b-4a81-846d-d8994842a249 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:28.525865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e23530ab-959b-4a81-846d-d8994842a249 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:28.526293 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e23530ab-959b-4a81-846d-d8994842a249 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:28.656850 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e23530ab-959b-4a81-846d-d8994842a249 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:28.667180 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e23530ab-959b-4a81-846d-d8994842a249 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:28.668735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e23530ab-959b-4a81-846d-d8994842a249 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:28.669941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e23530ab-959b-4a81-846d-d8994842a249 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.156730 Sep 03 01:36:28.670547 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 264/521] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:28 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:29.047242 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2f360652-fa61-47e0-b936-887c4ccdb85c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:29.047844 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2f360652-fa61-47e0-b936-887c4ccdb85c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:29.054839 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2f360652-fa61-47e0-b936-887c4ccdb85c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:29.055317 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2f360652-fa61-47e0-b936-887c4ccdb85c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:29.055745 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2f360652-fa61-47e0-b936-887c4ccdb85c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:29.056493 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2f360652-fa61-47e0-b936-887c4ccdb85c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:29.056872 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2f360652-fa61-47e0-b936-887c4ccdb85c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:29.057291 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2f360652-fa61-47e0-b936-887c4ccdb85c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:29.187946 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2f360652-fa61-47e0-b936-887c4ccdb85c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:29.196269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2f360652-fa61-47e0-b936-887c4ccdb85c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.152913 Sep 03 01:36:29.196827 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 258/522] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:29 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:29.696579 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7b187803-f0c3-4972-b97d-8d7667734b3a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:29.697163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7b187803-f0c3-4972-b97d-8d7667734b3a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:29.703896 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7b187803-f0c3-4972-b97d-8d7667734b3a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:29.704429 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7b187803-f0c3-4972-b97d-8d7667734b3a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:29.704864 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7b187803-f0c3-4972-b97d-8d7667734b3a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:29.705544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7b187803-f0c3-4972-b97d-8d7667734b3a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:29.705989 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7b187803-f0c3-4972-b97d-8d7667734b3a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:29.707051 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7b187803-f0c3-4972-b97d-8d7667734b3a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:29.729217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:29.866801 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7b187803-f0c3-4972-b97d-8d7667734b3a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:29.875449 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7b187803-f0c3-4972-b97d-8d7667734b3a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:29.876884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7b187803-f0c3-4972-b97d-8d7667734b3a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:29.878047 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7b187803-f0c3-4972-b97d-8d7667734b3a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.185902 Sep 03 01:36:29.878708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 265/523] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:29 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:30.222368 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5a647522-0c42-4ab4-af91-6f3271759b73 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:30.223461 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5a647522-0c42-4ab4-af91-6f3271759b73 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:30.230267 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a647522-0c42-4ab4-af91-6f3271759b73 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:30.230775 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a647522-0c42-4ab4-af91-6f3271759b73 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:30.231199 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a647522-0c42-4ab4-af91-6f3271759b73 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:30.231883 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a647522-0c42-4ab4-af91-6f3271759b73 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:30.232326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a647522-0c42-4ab4-af91-6f3271759b73 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:30.232744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a647522-0c42-4ab4-af91-6f3271759b73 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:30.363343 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5a647522-0c42-4ab4-af91-6f3271759b73 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:30.371317 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5a647522-0c42-4ab4-af91-6f3271759b73 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.156196 Sep 03 01:36:30.372662 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 259/524] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:30 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:30.903837 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7f7f1bc9-2238-4830-9063-1da565e77c2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:30.904441 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7f7f1bc9-2238-4830-9063-1da565e77c2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:30.911536 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7f7f1bc9-2238-4830-9063-1da565e77c2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:30.912016 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7f7f1bc9-2238-4830-9063-1da565e77c2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:30.912449 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7f7f1bc9-2238-4830-9063-1da565e77c2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:30.913130 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7f7f1bc9-2238-4830-9063-1da565e77c2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:30.913573 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7f7f1bc9-2238-4830-9063-1da565e77c2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:30.913990 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7f7f1bc9-2238-4830-9063-1da565e77c2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:31.039980 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7f7f1bc9-2238-4830-9063-1da565e77c2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:31.048051 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7f7f1bc9-2238-4830-9063-1da565e77c2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:31.049483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7f7f1bc9-2238-4830-9063-1da565e77c2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:31.051302 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7f7f1bc9-2238-4830-9063-1da565e77c2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.151323 Sep 03 01:36:31.051868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 266/525] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:30 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:31.397882 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-68708c02-ad9d-463d-b2a0-b2c42ba8c08b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:31.398547 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-68708c02-ad9d-463d-b2a0-b2c42ba8c08b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:31.405146 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68708c02-ad9d-463d-b2a0-b2c42ba8c08b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:31.405647 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68708c02-ad9d-463d-b2a0-b2c42ba8c08b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:31.406075 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68708c02-ad9d-463d-b2a0-b2c42ba8c08b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:31.407039 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68708c02-ad9d-463d-b2a0-b2c42ba8c08b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:31.407482 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68708c02-ad9d-463d-b2a0-b2c42ba8c08b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:31.407896 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68708c02-ad9d-463d-b2a0-b2c42ba8c08b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:31.753294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-68708c02-ad9d-463d-b2a0-b2c42ba8c08b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:31.760972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-68708c02-ad9d-463d-b2a0-b2c42ba8c08b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.367478 Sep 03 01:36:31.761594 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 260/526] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:31 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:32.076181 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e58517e0-0082-4e9e-9dc6-81985f704efb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:32.076744 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e58517e0-0082-4e9e-9dc6-81985f704efb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:32.083277 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e58517e0-0082-4e9e-9dc6-81985f704efb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:32.083763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e58517e0-0082-4e9e-9dc6-81985f704efb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:32.084206 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e58517e0-0082-4e9e-9dc6-81985f704efb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:32.084893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e58517e0-0082-4e9e-9dc6-81985f704efb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:32.085348 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e58517e0-0082-4e9e-9dc6-81985f704efb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:32.085776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e58517e0-0082-4e9e-9dc6-81985f704efb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:32.450813 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e58517e0-0082-4e9e-9dc6-81985f704efb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:32.459713 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e58517e0-0082-4e9e-9dc6-81985f704efb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:32.461149 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e58517e0-0082-4e9e-9dc6-81985f704efb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:32.462311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e58517e0-0082-4e9e-9dc6-81985f704efb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.390141 Sep 03 01:36:32.462899 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 267/527] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:32 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:32.783343 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b700130b-71fa-4ecf-996b-95470dc4d4fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:32.783977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b700130b-71fa-4ecf-996b-95470dc4d4fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:32.790509 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b700130b-71fa-4ecf-996b-95470dc4d4fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:32.790996 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b700130b-71fa-4ecf-996b-95470dc4d4fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:32.791431 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b700130b-71fa-4ecf-996b-95470dc4d4fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:32.792128 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b700130b-71fa-4ecf-996b-95470dc4d4fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:32.792582 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b700130b-71fa-4ecf-996b-95470dc4d4fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:32.793007 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b700130b-71fa-4ecf-996b-95470dc4d4fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:32.926027 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b700130b-71fa-4ecf-996b-95470dc4d4fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:32.933620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b700130b-71fa-4ecf-996b-95470dc4d4fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.154411 Sep 03 01:36:32.934172 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 261/528] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:32 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:33.487484 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ac3658ab-e24c-4d9e-b770-70dc9c024fb9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:33.488247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ac3658ab-e24c-4d9e-b770-70dc9c024fb9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:33.494088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ac3658ab-e24c-4d9e-b770-70dc9c024fb9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:33.494602 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ac3658ab-e24c-4d9e-b770-70dc9c024fb9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:33.495042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ac3658ab-e24c-4d9e-b770-70dc9c024fb9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:33.495731 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ac3658ab-e24c-4d9e-b770-70dc9c024fb9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:33.496185 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ac3658ab-e24c-4d9e-b770-70dc9c024fb9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:33.496610 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ac3658ab-e24c-4d9e-b770-70dc9c024fb9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:33.625195 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ac3658ab-e24c-4d9e-b770-70dc9c024fb9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:33.633452 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ac3658ab-e24c-4d9e-b770-70dc9c024fb9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:33.634919 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ac3658ab-e24c-4d9e-b770-70dc9c024fb9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:33.636068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ac3658ab-e24c-4d9e-b770-70dc9c024fb9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1740 microversion: 2.20 time: 0.152482 Sep 03 01:36:33.636633 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 268/529] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:33 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1740 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:36:33.955655 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2afc43e7-4344-4535-9bc5-6a6a7235bc59 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:33.956350 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2afc43e7-4344-4535-9bc5-6a6a7235bc59 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:33.963021 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2afc43e7-4344-4535-9bc5-6a6a7235bc59 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:33.969718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2afc43e7-4344-4535-9bc5-6a6a7235bc59 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:33.969718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2afc43e7-4344-4535-9bc5-6a6a7235bc59 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:33.969718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2afc43e7-4344-4535-9bc5-6a6a7235bc59 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:33.969718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2afc43e7-4344-4535-9bc5-6a6a7235bc59 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:33.970109 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2afc43e7-4344-4535-9bc5-6a6a7235bc59 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:34.113463 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2afc43e7-4344-4535-9bc5-6a6a7235bc59 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:34.121990 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2afc43e7-4344-4535-9bc5-6a6a7235bc59 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.170141 Sep 03 01:36:34.124836 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 262/530] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:33 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:34.663419 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8ffd5b78-063a-476f-a856-78dc14c40844 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:34.664170 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-8ffd5b78-063a-476f-a856-78dc14c40844 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:34.670471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ffd5b78-063a-476f-a856-78dc14c40844 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:34.671046 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ffd5b78-063a-476f-a856-78dc14c40844 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:34.671477 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ffd5b78-063a-476f-a856-78dc14c40844 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:34.673752 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ffd5b78-063a-476f-a856-78dc14c40844 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:34.673752 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ffd5b78-063a-476f-a856-78dc14c40844 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:34.673752 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ffd5b78-063a-476f-a856-78dc14c40844 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:34.814936 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8ffd5b78-063a-476f-a856-78dc14c40844 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:34.823450 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8ffd5b78-063a-476f-a856-78dc14c40844 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:34.825152 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8ffd5b78-063a-476f-a856-78dc14c40844 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:34.826548 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-8ffd5b78-063a-476f-a856-78dc14c40844 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1722 microversion: 2.20 time: 0.167529 Sep 03 01:36:34.827603 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 269/531] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:34 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:35.147532 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a9a07bdd-28c3-4733-81f8-2652ce28c579 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:35.148199 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a9a07bdd-28c3-4733-81f8-2652ce28c579 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:35.155527 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a9a07bdd-28c3-4733-81f8-2652ce28c579 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:35.156004 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a9a07bdd-28c3-4733-81f8-2652ce28c579 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:35.156437 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a9a07bdd-28c3-4733-81f8-2652ce28c579 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:35.157445 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a9a07bdd-28c3-4733-81f8-2652ce28c579 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:35.157888 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a9a07bdd-28c3-4733-81f8-2652ce28c579 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:35.158303 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a9a07bdd-28c3-4733-81f8-2652ce28c579 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:35.287637 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a9a07bdd-28c3-4733-81f8-2652ce28c579 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:35.295247 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a9a07bdd-28c3-4733-81f8-2652ce28c579 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.153226 Sep 03 01:36:35.295826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 263/532] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:35 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:35.853613 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c18be061-c50e-4d48-bd55-dc170ab30e2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:35.854225 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c18be061-c50e-4d48-bd55-dc170ab30e2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:35.860158 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c18be061-c50e-4d48-bd55-dc170ab30e2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:35.860635 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c18be061-c50e-4d48-bd55-dc170ab30e2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:35.861066 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c18be061-c50e-4d48-bd55-dc170ab30e2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:35.861741 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c18be061-c50e-4d48-bd55-dc170ab30e2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:35.862186 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c18be061-c50e-4d48-bd55-dc170ab30e2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:35.863282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c18be061-c50e-4d48-bd55-dc170ab30e2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:35.991721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c18be061-c50e-4d48-bd55-dc170ab30e2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:36.000702 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c18be061-c50e-4d48-bd55-dc170ab30e2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:36.002228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c18be061-c50e-4d48-bd55-dc170ab30e2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:36.003497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c18be061-c50e-4d48-bd55-dc170ab30e2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1722 microversion: 2.20 time: 0.153809 Sep 03 01:36:36.004050 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 270/533] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:35 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:36.320475 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4eec26de-8c59-43f6-965c-2c2bee70d6c9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:36.321416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4eec26de-8c59-43f6-965c-2c2bee70d6c9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:36.329905 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4eec26de-8c59-43f6-965c-2c2bee70d6c9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:36.330440 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4eec26de-8c59-43f6-965c-2c2bee70d6c9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:36.331004 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4eec26de-8c59-43f6-965c-2c2bee70d6c9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:36.332511 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4eec26de-8c59-43f6-965c-2c2bee70d6c9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:36.332965 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4eec26de-8c59-43f6-965c-2c2bee70d6c9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:36.333391 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4eec26de-8c59-43f6-965c-2c2bee70d6c9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:36.460230 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4eec26de-8c59-43f6-965c-2c2bee70d6c9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:36.467815 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4eec26de-8c59-43f6-965c-2c2bee70d6c9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.153845 Sep 03 01:36:36.468385 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 264/534] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:36 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:37.034511 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b09db627-c2b4-4961-880b-2bf509688d8d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:37.034511 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b09db627-c2b4-4961-880b-2bf509688d8d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:37.037584 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b09db627-c2b4-4961-880b-2bf509688d8d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:37.038062 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b09db627-c2b4-4961-880b-2bf509688d8d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:37.038540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b09db627-c2b4-4961-880b-2bf509688d8d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:37.039233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b09db627-c2b4-4961-880b-2bf509688d8d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:37.039712 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b09db627-c2b4-4961-880b-2bf509688d8d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:37.040114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b09db627-c2b4-4961-880b-2bf509688d8d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:37.176123 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b09db627-c2b4-4961-880b-2bf509688d8d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:37.184949 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b09db627-c2b4-4961-880b-2bf509688d8d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:37.186419 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b09db627-c2b4-4961-880b-2bf509688d8d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:37.187595 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b09db627-c2b4-4961-880b-2bf509688d8d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1722 microversion: 2.20 time: 0.161021 Sep 03 01:36:37.188166 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 271/535] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:37 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:37.491752 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-68a4e215-29b1-43e9-8476-d5b423d1e671 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:37.492364 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-68a4e215-29b1-43e9-8476-d5b423d1e671 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:37.498800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68a4e215-29b1-43e9-8476-d5b423d1e671 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:37.499356 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68a4e215-29b1-43e9-8476-d5b423d1e671 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:37.499707 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68a4e215-29b1-43e9-8476-d5b423d1e671 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:37.500398 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68a4e215-29b1-43e9-8476-d5b423d1e671 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:37.500851 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68a4e215-29b1-43e9-8476-d5b423d1e671 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:37.501275 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-68a4e215-29b1-43e9-8476-d5b423d1e671 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:37.521861 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=100 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:37.636167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-68a4e215-29b1-43e9-8476-d5b423d1e671 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:37.645584 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-68a4e215-29b1-43e9-8476-d5b423d1e671 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.158272 Sep 03 01:36:37.646312 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 265/536] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:37 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:38.214441 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5d5b6339-d7cb-43c5-9d4b-8b7a5aaf278b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:38.214964 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5d5b6339-d7cb-43c5-9d4b-8b7a5aaf278b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:38.221025 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5d5b6339-d7cb-43c5-9d4b-8b7a5aaf278b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:38.221502 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5d5b6339-d7cb-43c5-9d4b-8b7a5aaf278b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:38.222036 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5d5b6339-d7cb-43c5-9d4b-8b7a5aaf278b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:38.222641 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5d5b6339-d7cb-43c5-9d4b-8b7a5aaf278b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:38.223094 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5d5b6339-d7cb-43c5-9d4b-8b7a5aaf278b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:38.223517 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5d5b6339-d7cb-43c5-9d4b-8b7a5aaf278b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:38.352409 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5d5b6339-d7cb-43c5-9d4b-8b7a5aaf278b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:38.360526 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5d5b6339-d7cb-43c5-9d4b-8b7a5aaf278b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:38.361968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5d5b6339-d7cb-43c5-9d4b-8b7a5aaf278b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:38.363183 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5d5b6339-d7cb-43c5-9d4b-8b7a5aaf278b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1722 microversion: 2.20 time: 0.152764 Sep 03 01:36:38.363746 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 272/537] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:38 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:38.669755 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9da9ab80-3974-409a-b867-04c017f45fa4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:38.670288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9da9ab80-3974-409a-b867-04c017f45fa4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:38.677738 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9da9ab80-3974-409a-b867-04c017f45fa4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:38.678217 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9da9ab80-3974-409a-b867-04c017f45fa4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:38.678767 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9da9ab80-3974-409a-b867-04c017f45fa4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:38.679454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9da9ab80-3974-409a-b867-04c017f45fa4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:38.679901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9da9ab80-3974-409a-b867-04c017f45fa4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:38.680321 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9da9ab80-3974-409a-b867-04c017f45fa4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:38.809872 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9da9ab80-3974-409a-b867-04c017f45fa4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:38.818744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9da9ab80-3974-409a-b867-04c017f45fa4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.153525 Sep 03 01:36:38.819460 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 266/538] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:38 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:38.926915 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-6664df65-0f7c-4a35-be0b-47419f270164 req-4db30d46-83f5-412d-a57f-953dbe8453de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329ea656-c337-4f07-bd3d-9f67c4d6418e", "name": "network-vif-unplugged", "status": "completed", "tag": "8e331545-f680-453c-942e-5cd9fc274b5f"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:38.936710 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-6664df65-0f7c-4a35-be0b-47419f270164 req-4db30d46-83f5-412d-a57f-953dbe8453de service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:38.937171 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-6664df65-0f7c-4a35-be0b-47419f270164 req-4db30d46-83f5-412d-a57f-953dbe8453de service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:38.937632 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-6664df65-0f7c-4a35-be0b-47419f270164 req-4db30d46-83f5-412d-a57f-953dbe8453de service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:38.949805 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-6664df65-0f7c-4a35-be0b-47419f270164 req-4db30d46-83f5-412d-a57f-953dbe8453de service nova] Creating event network-vif-unplugged:8e331545-f680-453c-942e-5cd9fc274b5f for instance 329ea656-c337-4f07-bd3d-9f67c4d6418e on hv-cinder-83800 Sep 03 01:36:38.955039 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-6664df65-0f7c-4a35-be0b-47419f270164 req-4db30d46-83f5-412d-a57f-953dbe8453de service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032777 Sep 03 01:36:38.955773 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 273/539] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:36:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:36:39.389305 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-fae5acc4-1e59-4178-b444-97ef76101d3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:39.389917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-fae5acc4-1e59-4178-b444-97ef76101d3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:39.396754 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fae5acc4-1e59-4178-b444-97ef76101d3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:39.397242 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fae5acc4-1e59-4178-b444-97ef76101d3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:39.397677 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fae5acc4-1e59-4178-b444-97ef76101d3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:39.398391 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fae5acc4-1e59-4178-b444-97ef76101d3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:39.399276 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fae5acc4-1e59-4178-b444-97ef76101d3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:39.399705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fae5acc4-1e59-4178-b444-97ef76101d3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:39.535966 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-fae5acc4-1e59-4178-b444-97ef76101d3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:39.544382 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-fae5acc4-1e59-4178-b444-97ef76101d3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:39.545840 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-fae5acc4-1e59-4178-b444-97ef76101d3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:39.547061 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-fae5acc4-1e59-4178-b444-97ef76101d3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1722 microversion: 2.20 time: 0.161806 Sep 03 01:36:39.550360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 267/540] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:39 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:36:39.842419 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8b7e27ea-dfc6-4d7a-854b-46d879691078 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:39.843239 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-8b7e27ea-dfc6-4d7a-854b-46d879691078 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:39.850212 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8b7e27ea-dfc6-4d7a-854b-46d879691078 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:39.850723 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8b7e27ea-dfc6-4d7a-854b-46d879691078 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:39.851161 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8b7e27ea-dfc6-4d7a-854b-46d879691078 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:39.851848 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8b7e27ea-dfc6-4d7a-854b-46d879691078 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:39.852300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8b7e27ea-dfc6-4d7a-854b-46d879691078 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:39.852749 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8b7e27ea-dfc6-4d7a-854b-46d879691078 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:39.992200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8b7e27ea-dfc6-4d7a-854b-46d879691078 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:40.000423 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-8b7e27ea-dfc6-4d7a-854b-46d879691078 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.162309 Sep 03 01:36:40.001026 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 274/541] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:39 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:40.507107 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2d31b7f6-154d-49bf-a3c7-f695c36d0264 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:40.509390 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2d31b7f6-154d-49bf-a3c7-f695c36d0264 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:40.516037 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2d31b7f6-154d-49bf-a3c7-f695c36d0264 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:40.516729 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2d31b7f6-154d-49bf-a3c7-f695c36d0264 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:40.517320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2d31b7f6-154d-49bf-a3c7-f695c36d0264 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:40.518185 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2d31b7f6-154d-49bf-a3c7-f695c36d0264 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:40.519414 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2d31b7f6-154d-49bf-a3c7-f695c36d0264 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:40.520091 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2d31b7f6-154d-49bf-a3c7-f695c36d0264 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:40.545191 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-2d31b7f6-154d-49bf-a3c7-f695c36d0264 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lazy-loading 'flavor' on Instance uuid 34abe46a-5361-4e96-a952-5909fad8c4f4 {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:36:40.574505 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e6c5be0d-0d20-4dc8-a4a5-ebe5f1c420dc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:40.575096 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e6c5be0d-0d20-4dc8-a4a5-ebe5f1c420dc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:40.581866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6c5be0d-0d20-4dc8-a4a5-ebe5f1c420dc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:40.582396 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6c5be0d-0d20-4dc8-a4a5-ebe5f1c420dc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:40.582814 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6c5be0d-0d20-4dc8-a4a5-ebe5f1c420dc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:40.583511 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6c5be0d-0d20-4dc8-a4a5-ebe5f1c420dc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:40.583970 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6c5be0d-0d20-4dc8-a4a5-ebe5f1c420dc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:40.584391 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e6c5be0d-0d20-4dc8-a4a5-ebe5f1c420dc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:40.732597 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e6c5be0d-0d20-4dc8-a4a5-ebe5f1c420dc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:40.751030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e6c5be0d-0d20-4dc8-a4a5-ebe5f1c420dc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:40.751030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e6c5be0d-0d20-4dc8-a4a5-ebe5f1c420dc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:40.751030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e6c5be0d-0d20-4dc8-a4a5-ebe5f1c420dc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1722 microversion: 2.20 time: 0.175200 Sep 03 01:36:40.751301 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 275/542] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:40 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:41.024089 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-1b7f61b8-6705-45a8-8055-a6e2ded37ebb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:41.024722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-1b7f61b8-6705-45a8-8055-a6e2ded37ebb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:41.030918 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1b7f61b8-6705-45a8-8055-a6e2ded37ebb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:41.041738 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1b7f61b8-6705-45a8-8055-a6e2ded37ebb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:41.041738 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1b7f61b8-6705-45a8-8055-a6e2ded37ebb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:41.041738 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1b7f61b8-6705-45a8-8055-a6e2ded37ebb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:41.041738 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1b7f61b8-6705-45a8-8055-a6e2ded37ebb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:41.042133 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1b7f61b8-6705-45a8-8055-a6e2ded37ebb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:41.162408 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1b7f61b8-6705-45a8-8055-a6e2ded37ebb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:41.170046 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-1b7f61b8-6705-45a8-8055-a6e2ded37ebb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.150200 Sep 03 01:36:41.170646 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 276/543] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:41 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:36:41.325755 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2d31b7f6-154d-49bf-a3c7-f695c36d0264 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "POST /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/action" status: 200 len: 32 microversion: 2.1 time: 0.818937 Sep 03 01:36:41.325755 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 268/544] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:36:40 2022] POST /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/action => generated 32 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 01:36:41.340720 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3ae75c84-f250-4978-987f-b0b9388dfbf3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:41.341633 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-3ae75c84-f250-4978-987f-b0b9388dfbf3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:41.349034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3ae75c84-f250-4978-987f-b0b9388dfbf3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:41.349565 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3ae75c84-f250-4978-987f-b0b9388dfbf3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:41.350005 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3ae75c84-f250-4978-987f-b0b9388dfbf3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:41.350850 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3ae75c84-f250-4978-987f-b0b9388dfbf3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:41.351441 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3ae75c84-f250-4978-987f-b0b9388dfbf3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:41.351872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3ae75c84-f250-4978-987f-b0b9388dfbf3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:41.621544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3ae75c84-f250-4978-987f-b0b9388dfbf3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:41.633479 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3ae75c84-f250-4978-987f-b0b9388dfbf3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.303336 Sep 03 01:36:41.634808 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 277/545] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:41 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:41.777035 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-70b499b6-3056-4507-9c28-2027704f20a2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:41.777742 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-70b499b6-3056-4507-9c28-2027704f20a2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:41.788011 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-70b499b6-3056-4507-9c28-2027704f20a2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:41.788883 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-70b499b6-3056-4507-9c28-2027704f20a2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:41.789555 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-70b499b6-3056-4507-9c28-2027704f20a2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:41.790604 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-70b499b6-3056-4507-9c28-2027704f20a2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:41.791414 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-70b499b6-3056-4507-9c28-2027704f20a2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:41.792037 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-70b499b6-3056-4507-9c28-2027704f20a2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:41.968947 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-70b499b6-3056-4507-9c28-2027704f20a2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:41.978812 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-70b499b6-3056-4507-9c28-2027704f20a2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:41.980470 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-70b499b6-3056-4507-9c28-2027704f20a2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:41.981969 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-70b499b6-3056-4507-9c28-2027704f20a2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1722 microversion: 2.20 time: 0.210146 Sep 03 01:36:41.982613 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 269/546] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:41 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:42.193213 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0da81aed-bcae-4fbb-8e24-bd8ee31b0dcf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:42.193824 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0da81aed-bcae-4fbb-8e24-bd8ee31b0dcf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:42.200006 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0da81aed-bcae-4fbb-8e24-bd8ee31b0dcf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:42.200664 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0da81aed-bcae-4fbb-8e24-bd8ee31b0dcf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:42.201902 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0da81aed-bcae-4fbb-8e24-bd8ee31b0dcf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:42.202330 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0da81aed-bcae-4fbb-8e24-bd8ee31b0dcf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:42.202808 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0da81aed-bcae-4fbb-8e24-bd8ee31b0dcf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:42.203296 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0da81aed-bcae-4fbb-8e24-bd8ee31b0dcf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:42.351897 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0da81aed-bcae-4fbb-8e24-bd8ee31b0dcf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:42.359870 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0da81aed-bcae-4fbb-8e24-bd8ee31b0dcf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.170840 Sep 03 01:36:42.360616 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 278/547] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:42 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:42.657383 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-abdb8db2-de27-4fe0-9993-3ab302e2bb32 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:42.657940 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-abdb8db2-de27-4fe0-9993-3ab302e2bb32 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:42.663908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-abdb8db2-de27-4fe0-9993-3ab302e2bb32 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:42.664354 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-abdb8db2-de27-4fe0-9993-3ab302e2bb32 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:42.664792 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-abdb8db2-de27-4fe0-9993-3ab302e2bb32 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:42.665492 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-abdb8db2-de27-4fe0-9993-3ab302e2bb32 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:42.665943 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-abdb8db2-de27-4fe0-9993-3ab302e2bb32 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:42.666393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-abdb8db2-de27-4fe0-9993-3ab302e2bb32 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:42.798022 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-abdb8db2-de27-4fe0-9993-3ab302e2bb32 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:42.814550 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-abdb8db2-de27-4fe0-9993-3ab302e2bb32 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.154081 Sep 03 01:36:42.814550 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 270/548] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:42 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:43.025545 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-72007ed1-8edb-4e31-8029-8d0f225b6df6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:43.026152 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-72007ed1-8edb-4e31-8029-8d0f225b6df6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:43.028176 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=58 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:43.033130 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72007ed1-8edb-4e31-8029-8d0f225b6df6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:43.033623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72007ed1-8edb-4e31-8029-8d0f225b6df6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:43.034122 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72007ed1-8edb-4e31-8029-8d0f225b6df6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:43.034915 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72007ed1-8edb-4e31-8029-8d0f225b6df6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:43.035366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72007ed1-8edb-4e31-8029-8d0f225b6df6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:43.035792 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72007ed1-8edb-4e31-8029-8d0f225b6df6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:43.052998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-f5fa41b9-c5cf-4e32-98e9-0c2d86dad41e req-42e6634b-d169-4a40-9556-b62fecc2aa44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5df2d41-c884-4178-9a70-150c16cf1c5f", "name": "network-vif-plugged", "status": "completed", "tag": "f1b93106-790d-4f9d-9fae-cd59eef8bc20"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:43.063643 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-f5fa41b9-c5cf-4e32-98e9-0c2d86dad41e req-42e6634b-d169-4a40-9556-b62fecc2aa44 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:43.064124 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-f5fa41b9-c5cf-4e32-98e9-0c2d86dad41e req-42e6634b-d169-4a40-9556-b62fecc2aa44 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:43.064557 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-f5fa41b9-c5cf-4e32-98e9-0c2d86dad41e req-42e6634b-d169-4a40-9556-b62fecc2aa44 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:43.077189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-f5fa41b9-c5cf-4e32-98e9-0c2d86dad41e req-42e6634b-d169-4a40-9556-b62fecc2aa44 service nova] Creating event network-vif-plugged:f1b93106-790d-4f9d-9fae-cd59eef8bc20 for instance e5df2d41-c884-4178-9a70-150c16cf1c5f on hv-cinder-83800 Sep 03 01:36:43.083160 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-f5fa41b9-c5cf-4e32-98e9-0c2d86dad41e req-42e6634b-d169-4a40-9556-b62fecc2aa44 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034070 Sep 03 01:36:43.083769 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 271/549] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:36:43.168717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-72007ed1-8edb-4e31-8029-8d0f225b6df6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:43.177822 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-72007ed1-8edb-4e31-8029-8d0f225b6df6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:43.179284 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-72007ed1-8edb-4e31-8029-8d0f225b6df6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:43.180718 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-72007ed1-8edb-4e31-8029-8d0f225b6df6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1665 microversion: 2.20 time: 0.159135 Sep 03 01:36:43.182722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 279/550] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:43 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:43.208046 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f01c39ba-a631-4c81-b0ee-49d2cb7aee2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a0c7ba9b-87a5-4ce8-bb75-899d1942cb9a"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:43.210848 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f01c39ba-a631-4c81-b0ee-49d2cb7aee2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:43.217114 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f01c39ba-a631-4c81-b0ee-49d2cb7aee2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:43.217612 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f01c39ba-a631-4c81-b0ee-49d2cb7aee2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:43.218047 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f01c39ba-a631-4c81-b0ee-49d2cb7aee2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:43.219005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f01c39ba-a631-4c81-b0ee-49d2cb7aee2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:43.219467 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f01c39ba-a631-4c81-b0ee-49d2cb7aee2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:43.219892 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f01c39ba-a631-4c81-b0ee-49d2cb7aee2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:43.387653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7501e7a9-f339-4295-a28a-6688f70382e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:43.389108 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7501e7a9-f339-4295-a28a-6688f70382e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:43.402890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7501e7a9-f339-4295-a28a-6688f70382e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:43.403712 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7501e7a9-f339-4295-a28a-6688f70382e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:43.407410 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7501e7a9-f339-4295-a28a-6688f70382e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:43.413184 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7501e7a9-f339-4295-a28a-6688f70382e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:43.413791 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7501e7a9-f339-4295-a28a-6688f70382e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:43.414597 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7501e7a9-f339-4295-a28a-6688f70382e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:43.562138 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7501e7a9-f339-4295-a28a-6688f70382e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:43.570741 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7501e7a9-f339-4295-a28a-6688f70382e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.186847 Sep 03 01:36:43.582718 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 280/551] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:43 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:43.829870 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0ad74ecc-5f51-4f13-8e5b-75be5594e2de tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:43.830830 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0ad74ecc-5f51-4f13-8e5b-75be5594e2de tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:43.837355 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ad74ecc-5f51-4f13-8e5b-75be5594e2de tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:43.837895 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ad74ecc-5f51-4f13-8e5b-75be5594e2de tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:43.838371 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ad74ecc-5f51-4f13-8e5b-75be5594e2de tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:43.839068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ad74ecc-5f51-4f13-8e5b-75be5594e2de tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:43.839529 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ad74ecc-5f51-4f13-8e5b-75be5594e2de tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:43.839963 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ad74ecc-5f51-4f13-8e5b-75be5594e2de tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:43.989832 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0ad74ecc-5f51-4f13-8e5b-75be5594e2de tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:43.997995 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0ad74ecc-5f51-4f13-8e5b-75be5594e2de tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.172050 Sep 03 01:36:43.998606 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 281/552] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:43 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:36:44.278957 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f01c39ba-a631-4c81-b0ee-49d2cb7aee2d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "POST /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.075751 Sep 03 01:36:44.279604 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 272/553] 10.222.0.13 () {62 vars in 1364 bytes} [Sat Sep 3 01:36:43 2022] POST /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments => generated 188 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:36:44.420342 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-979d8e30-9dca-4e86-8785-ad615ae59d6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:44.420924 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-979d8e30-9dca-4e86-8785-ad615ae59d6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:44.430226 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-979d8e30-9dca-4e86-8785-ad615ae59d6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:44.431307 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-979d8e30-9dca-4e86-8785-ad615ae59d6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:44.431759 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-979d8e30-9dca-4e86-8785-ad615ae59d6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:44.432525 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-979d8e30-9dca-4e86-8785-ad615ae59d6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:44.432981 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-979d8e30-9dca-4e86-8785-ad615ae59d6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:44.433407 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-979d8e30-9dca-4e86-8785-ad615ae59d6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:44.481491 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-979d8e30-9dca-4e86-8785-ad615ae59d6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127552) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 03 01:36:44.558364 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:44.594313 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4f77ae7a-06a6-4790-bf97-4fae69a9c4e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:44.595026 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4f77ae7a-06a6-4790-bf97-4fae69a9c4e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:44.601477 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f77ae7a-06a6-4790-bf97-4fae69a9c4e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:44.601954 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f77ae7a-06a6-4790-bf97-4fae69a9c4e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:44.602408 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f77ae7a-06a6-4790-bf97-4fae69a9c4e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:44.603091 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f77ae7a-06a6-4790-bf97-4fae69a9c4e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:44.603574 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f77ae7a-06a6-4790-bf97-4fae69a9c4e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:44.604080 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4f77ae7a-06a6-4790-bf97-4fae69a9c4e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:44.743948 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4f77ae7a-06a6-4790-bf97-4fae69a9c4e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:44.753099 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4f77ae7a-06a6-4790-bf97-4fae69a9c4e9 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1358 microversion: 2.1 time: 0.162272 Sep 03 01:36:44.753565 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 273/554] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:44 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:36:44.780999 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-979d8e30-9dca-4e86-8785-ad615ae59d6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "POST /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/action" status: 202 len: 0 microversion: 2.20 time: 0.363484 Sep 03 01:36:44.781879 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 282/555] 10.222.0.13 () {62 vars in 1319 bytes} [Sat Sep 3 01:36:44 2022] POST /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:36:44.791843 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4e22a6e0-1bee-489a-b15b-e57825ed6575 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:44.792385 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4e22a6e0-1bee-489a-b15b-e57825ed6575 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:44.811430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4e22a6e0-1bee-489a-b15b-e57825ed6575 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:44.811921 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4e22a6e0-1bee-489a-b15b-e57825ed6575 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:44.812362 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4e22a6e0-1bee-489a-b15b-e57825ed6575 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:44.813065 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4e22a6e0-1bee-489a-b15b-e57825ed6575 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:44.813566 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4e22a6e0-1bee-489a-b15b-e57825ed6575 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:44.813919 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4e22a6e0-1bee-489a-b15b-e57825ed6575 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:44.971706 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4e22a6e0-1bee-489a-b15b-e57825ed6575 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:44.981373 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4e22a6e0-1bee-489a-b15b-e57825ed6575 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:44.983035 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4e22a6e0-1bee-489a-b15b-e57825ed6575 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:44.984184 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4e22a6e0-1bee-489a-b15b-e57825ed6575 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1751 microversion: 2.20 time: 0.196610 Sep 03 01:36:44.984747 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 274/556] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:44 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:45.023261 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a93a4113-a0e3-486c-b044-4546b8bd4f4f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:45.023760 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a93a4113-a0e3-486c-b044-4546b8bd4f4f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:45.030202 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a93a4113-a0e3-486c-b044-4546b8bd4f4f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:45.030725 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a93a4113-a0e3-486c-b044-4546b8bd4f4f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:45.032620 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a93a4113-a0e3-486c-b044-4546b8bd4f4f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:45.032620 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a93a4113-a0e3-486c-b044-4546b8bd4f4f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:45.033102 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a93a4113-a0e3-486c-b044-4546b8bd4f4f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:45.033532 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a93a4113-a0e3-486c-b044-4546b8bd4f4f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:45.194912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a93a4113-a0e3-486c-b044-4546b8bd4f4f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:45.207737 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a93a4113-a0e3-486c-b044-4546b8bd4f4f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.189591 Sep 03 01:36:45.210708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 283/557] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:45 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:45.775004 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-45ca2caa-8407-41b5-a92e-81dc1cb11bae tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:45.775690 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-45ca2caa-8407-41b5-a92e-81dc1cb11bae tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:45.792727 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-45ca2caa-8407-41b5-a92e-81dc1cb11bae tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:45.793224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-45ca2caa-8407-41b5-a92e-81dc1cb11bae tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:45.793663 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-45ca2caa-8407-41b5-a92e-81dc1cb11bae tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:45.794424 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-45ca2caa-8407-41b5-a92e-81dc1cb11bae tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:45.794886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-45ca2caa-8407-41b5-a92e-81dc1cb11bae tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:45.795315 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-45ca2caa-8407-41b5-a92e-81dc1cb11bae tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:45.942060 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-45ca2caa-8407-41b5-a92e-81dc1cb11bae tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:45.952352 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-45ca2caa-8407-41b5-a92e-81dc1cb11bae tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1549 microversion: 2.1 time: 0.181074 Sep 03 01:36:45.952929 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 275/558] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:45 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1549 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:45.976039 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-06bb9a16-e732-4d9d-b704-3b705297f96c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:45.976657 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-06bb9a16-e732-4d9d-b704-3b705297f96c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:45.982587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-06bb9a16-e732-4d9d-b704-3b705297f96c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:45.983823 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-06bb9a16-e732-4d9d-b704-3b705297f96c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:45.983823 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-06bb9a16-e732-4d9d-b704-3b705297f96c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:45.984317 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-06bb9a16-e732-4d9d-b704-3b705297f96c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:45.985397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-06bb9a16-e732-4d9d-b704-3b705297f96c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:45.985823 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-06bb9a16-e732-4d9d-b704-3b705297f96c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:46.009788 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-40386073-4d18-449b-8217-b588b0d6408b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:46.010500 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-40386073-4d18-449b-8217-b588b0d6408b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:46.016821 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40386073-4d18-449b-8217-b588b0d6408b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:46.017503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40386073-4d18-449b-8217-b588b0d6408b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:46.018088 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40386073-4d18-449b-8217-b588b0d6408b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:46.019584 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40386073-4d18-449b-8217-b588b0d6408b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:46.020395 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40386073-4d18-449b-8217-b588b0d6408b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:46.020970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40386073-4d18-449b-8217-b588b0d6408b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:46.122443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-06bb9a16-e732-4d9d-b704-3b705297f96c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:46.133179 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-06bb9a16-e732-4d9d-b704-3b705297f96c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1549 microversion: 2.1 time: 0.161334 Sep 03 01:36:46.133928 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 284/559] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:45 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1549 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:46.159562 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d9600936-139e-414a-8eb9-440313efa91c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:46.164808 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d9600936-139e-414a-8eb9-440313efa91c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:46.174133 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d9600936-139e-414a-8eb9-440313efa91c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Searching by: {'deleted': False, 'project_id': '364812df6abf492698453972e9a1d120'} {{(pid=127552) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 03 01:36:46.179845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-40386073-4d18-449b-8217-b588b0d6408b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:46.184914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d9600936-139e-414a-8eb9-440313efa91c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:46.185708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d9600936-139e-414a-8eb9-440313efa91c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:46.186023 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d9600936-139e-414a-8eb9-440313efa91c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:46.186902 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d9600936-139e-414a-8eb9-440313efa91c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:46.187265 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d9600936-139e-414a-8eb9-440313efa91c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:46.187785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d9600936-139e-414a-8eb9-440313efa91c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:46.204097 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-40386073-4d18-449b-8217-b588b0d6408b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:46.207719 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-40386073-4d18-449b-8217-b588b0d6408b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:46.211245 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-40386073-4d18-449b-8217-b588b0d6408b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1751 microversion: 2.20 time: 0.204529 Sep 03 01:36:46.213097 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 276/560] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:46 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1751 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:36:46.234877 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-86f71dc7-c2f9-4956-9480-ccd598a086e2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:46.235602 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-86f71dc7-c2f9-4956-9480-ccd598a086e2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:46.243143 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-86f71dc7-c2f9-4956-9480-ccd598a086e2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:46.243641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-86f71dc7-c2f9-4956-9480-ccd598a086e2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:46.244077 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-86f71dc7-c2f9-4956-9480-ccd598a086e2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:46.244773 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-86f71dc7-c2f9-4956-9480-ccd598a086e2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:46.245225 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-86f71dc7-c2f9-4956-9480-ccd598a086e2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:46.245709 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-86f71dc7-c2f9-4956-9480-ccd598a086e2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:46.293005 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.multi_cell_list [None req-d9600936-139e-414a-8eb9-440313efa91c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127552) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 03 01:36:46.411049 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d9600936-139e-414a-8eb9-440313efa91c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.255925 Sep 03 01:36:46.416275 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 285/561] 10.222.0.13 () {58 vars in 1125 bytes} [Sat Sep 3 01:36:46 2022] GET /compute/v2.1/servers => generated 342 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:36:46.428680 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c330c48d-b231-4fba-a6d9-bf08f9f8770e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:46.429283 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c330c48d-b231-4fba-a6d9-bf08f9f8770e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:46.432998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-86f71dc7-c2f9-4956-9480-ccd598a086e2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:46.437448 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c330c48d-b231-4fba-a6d9-bf08f9f8770e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:46.437448 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c330c48d-b231-4fba-a6d9-bf08f9f8770e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:46.437448 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c330c48d-b231-4fba-a6d9-bf08f9f8770e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:46.437961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c330c48d-b231-4fba-a6d9-bf08f9f8770e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:46.438056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c330c48d-b231-4fba-a6d9-bf08f9f8770e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:46.438517 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c330c48d-b231-4fba-a6d9-bf08f9f8770e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:46.446249 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-86f71dc7-c2f9-4956-9480-ccd598a086e2 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.215587 Sep 03 01:36:46.446943 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 277/562] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:46 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:36:46.625778 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c330c48d-b231-4fba-a6d9-bf08f9f8770e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:46.635349 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c330c48d-b231-4fba-a6d9-bf08f9f8770e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1549 microversion: 2.1 time: 0.212111 Sep 03 01:36:46.635984 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 286/563] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:46 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1549 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:47.245913 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d7de1364-a70f-4f0a-a178-eaf4ecabc8c0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:47.245913 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d7de1364-a70f-4f0a-a178-eaf4ecabc8c0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:47.249656 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d7de1364-a70f-4f0a-a178-eaf4ecabc8c0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:47.250139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d7de1364-a70f-4f0a-a178-eaf4ecabc8c0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:47.250594 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d7de1364-a70f-4f0a-a178-eaf4ecabc8c0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:47.251422 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d7de1364-a70f-4f0a-a178-eaf4ecabc8c0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:47.251874 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d7de1364-a70f-4f0a-a178-eaf4ecabc8c0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:47.252290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d7de1364-a70f-4f0a-a178-eaf4ecabc8c0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:47.257939 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:47.453295 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d7de1364-a70f-4f0a-a178-eaf4ecabc8c0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:47.464276 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d7de1364-a70f-4f0a-a178-eaf4ecabc8c0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:47.467396 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d7de1364-a70f-4f0a-a178-eaf4ecabc8c0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:47.468194 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d7de1364-a70f-4f0a-a178-eaf4ecabc8c0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1753 microversion: 2.20 time: 0.232521 Sep 03 01:36:47.474515 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 278/564] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:47 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1753 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:47.475782 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-00388b58-2090-49aa-97a9-319f578b63c1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:47.476564 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-00388b58-2090-49aa-97a9-319f578b63c1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:47.483655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00388b58-2090-49aa-97a9-319f578b63c1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:47.484407 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00388b58-2090-49aa-97a9-319f578b63c1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:47.485285 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00388b58-2090-49aa-97a9-319f578b63c1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:47.487097 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00388b58-2090-49aa-97a9-319f578b63c1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:47.487736 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00388b58-2090-49aa-97a9-319f578b63c1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:47.488296 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00388b58-2090-49aa-97a9-319f578b63c1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:47.663743 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-00388b58-2090-49aa-97a9-319f578b63c1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:47.672087 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-00388b58-2090-49aa-97a9-319f578b63c1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.201797 Sep 03 01:36:47.672671 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 287/565] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:47 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:36:48.511290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9a4105f0-1651-4c5e-beb4-e13c5b44e3b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:48.511890 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9a4105f0-1651-4c5e-beb4-e13c5b44e3b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:48.520083 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a4105f0-1651-4c5e-beb4-e13c5b44e3b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:48.520677 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a4105f0-1651-4c5e-beb4-e13c5b44e3b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:48.520992 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a4105f0-1651-4c5e-beb4-e13c5b44e3b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:48.521747 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a4105f0-1651-4c5e-beb4-e13c5b44e3b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:48.522496 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a4105f0-1651-4c5e-beb4-e13c5b44e3b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:48.522959 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a4105f0-1651-4c5e-beb4-e13c5b44e3b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:48.695878 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b2b3f162-c3da-443d-ba32-26a7210fc38c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:48.696510 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b2b3f162-c3da-443d-ba32-26a7210fc38c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:48.707596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2b3f162-c3da-443d-ba32-26a7210fc38c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:48.708236 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2b3f162-c3da-443d-ba32-26a7210fc38c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:48.708797 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2b3f162-c3da-443d-ba32-26a7210fc38c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:48.710667 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2b3f162-c3da-443d-ba32-26a7210fc38c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:48.711139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2b3f162-c3da-443d-ba32-26a7210fc38c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:48.711577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b2b3f162-c3da-443d-ba32-26a7210fc38c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:48.756996 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9a4105f0-1651-4c5e-beb4-e13c5b44e3b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:48.767765 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9a4105f0-1651-4c5e-beb4-e13c5b44e3b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:48.769690 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9a4105f0-1651-4c5e-beb4-e13c5b44e3b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:48.771097 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9a4105f0-1651-4c5e-beb4-e13c5b44e3b1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.263775 Sep 03 01:36:48.772131 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 279/566] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:48 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:48.777056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4886ddb5-50e4-40fd-a1b8-bfa8b1c5b561 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15040863-78fc-4b55-99f3-a542d3944e12"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:48.780365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4886ddb5-50e4-40fd-a1b8-bfa8b1c5b561 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:48.792916 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4886ddb5-50e4-40fd-a1b8-bfa8b1c5b561 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:48.793209 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4886ddb5-50e4-40fd-a1b8-bfa8b1c5b561 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:48.793791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4886ddb5-50e4-40fd-a1b8-bfa8b1c5b561 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:48.794545 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4886ddb5-50e4-40fd-a1b8-bfa8b1c5b561 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:48.794996 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4886ddb5-50e4-40fd-a1b8-bfa8b1c5b561 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:48.795421 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4886ddb5-50e4-40fd-a1b8-bfa8b1c5b561 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:48.928706 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b2b3f162-c3da-443d-ba32-26a7210fc38c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:48.938505 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b2b3f162-c3da-443d-ba32-26a7210fc38c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.246479 Sep 03 01:36:48.950904 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 288/567] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:48 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:49.798281 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f9c96b00-078a-419e-b347-2292cdf41ab6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:49.798942 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f9c96b00-078a-419e-b347-2292cdf41ab6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:49.805731 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9c96b00-078a-419e-b347-2292cdf41ab6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:49.806055 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9c96b00-078a-419e-b347-2292cdf41ab6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:49.806530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9c96b00-078a-419e-b347-2292cdf41ab6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:49.807233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9c96b00-078a-419e-b347-2292cdf41ab6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:49.807698 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9c96b00-078a-419e-b347-2292cdf41ab6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:49.814585 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f9c96b00-078a-419e-b347-2292cdf41ab6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:49.907148 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4886ddb5-50e4-40fd-a1b8-bfa8b1c5b561 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "POST /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.133404 Sep 03 01:36:49.908241 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 280/568] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:36:48 2022] POST /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 194 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:36:49.964001 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-41f210ee-6f85-43b8-88da-aa22f39089f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:49.964856 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-41f210ee-6f85-43b8-88da-aa22f39089f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:49.970364 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f9c96b00-078a-419e-b347-2292cdf41ab6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:49.980484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-41f210ee-6f85-43b8-88da-aa22f39089f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:49.981026 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-41f210ee-6f85-43b8-88da-aa22f39089f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:49.984753 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-41f210ee-6f85-43b8-88da-aa22f39089f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:49.984753 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-41f210ee-6f85-43b8-88da-aa22f39089f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:49.984753 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-41f210ee-6f85-43b8-88da-aa22f39089f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:49.984753 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-41f210ee-6f85-43b8-88da-aa22f39089f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:49.993178 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f9c96b00-078a-419e-b347-2292cdf41ab6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:49.994699 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f9c96b00-078a-419e-b347-2292cdf41ab6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:49.996319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f9c96b00-078a-419e-b347-2292cdf41ab6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.201790 Sep 03 01:36:49.996882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 289/569] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:49 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:36:50.222125 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-41f210ee-6f85-43b8-88da-aa22f39089f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:50.231314 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-41f210ee-6f85-43b8-88da-aa22f39089f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.271584 Sep 03 01:36:50.231879 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 281/570] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:49 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:36:51.024447 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0791ea42-cf78-4707-bfb3-ec3f120cde3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:51.025724 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0791ea42-cf78-4707-bfb3-ec3f120cde3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:51.038542 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0791ea42-cf78-4707-bfb3-ec3f120cde3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:51.041290 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0791ea42-cf78-4707-bfb3-ec3f120cde3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:51.044399 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0791ea42-cf78-4707-bfb3-ec3f120cde3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:51.044399 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0791ea42-cf78-4707-bfb3-ec3f120cde3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:51.044399 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0791ea42-cf78-4707-bfb3-ec3f120cde3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:51.044399 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0791ea42-cf78-4707-bfb3-ec3f120cde3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:51.262270 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-85d8aaeb-c66f-45ca-b2d2-5849250841df tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:51.263738 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-85d8aaeb-c66f-45ca-b2d2-5849250841df tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:51.279580 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-85d8aaeb-c66f-45ca-b2d2-5849250841df tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:51.282620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-85d8aaeb-c66f-45ca-b2d2-5849250841df tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:51.283256 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-85d8aaeb-c66f-45ca-b2d2-5849250841df tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:51.285540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-85d8aaeb-c66f-45ca-b2d2-5849250841df tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:51.287958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-85d8aaeb-c66f-45ca-b2d2-5849250841df tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:51.289168 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-85d8aaeb-c66f-45ca-b2d2-5849250841df tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:51.318099 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0791ea42-cf78-4707-bfb3-ec3f120cde3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:51.334666 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0791ea42-cf78-4707-bfb3-ec3f120cde3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:51.339782 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0791ea42-cf78-4707-bfb3-ec3f120cde3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:51.341246 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0791ea42-cf78-4707-bfb3-ec3f120cde3b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.321015 Sep 03 01:36:51.341978 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 290/571] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:51 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:51.471958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-85d8aaeb-c66f-45ca-b2d2-5849250841df tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:51.482094 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-85d8aaeb-c66f-45ca-b2d2-5849250841df tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.230612 Sep 03 01:36:51.483714 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 282/572] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:51 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:52.368738 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-01b96254-eddc-466a-917a-d86048be1f29 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:52.369500 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-01b96254-eddc-466a-917a-d86048be1f29 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:52.375812 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-01b96254-eddc-466a-917a-d86048be1f29 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:52.376600 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-01b96254-eddc-466a-917a-d86048be1f29 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:52.377058 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-01b96254-eddc-466a-917a-d86048be1f29 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:52.378137 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-01b96254-eddc-466a-917a-d86048be1f29 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:52.378799 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-01b96254-eddc-466a-917a-d86048be1f29 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:52.379241 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-01b96254-eddc-466a-917a-d86048be1f29 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:52.510536 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-437db43f-4f36-4a40-8d4c-aeef44a8b274 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:52.511315 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-437db43f-4f36-4a40-8d4c-aeef44a8b274 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:52.521800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-437db43f-4f36-4a40-8d4c-aeef44a8b274 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:52.522298 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-437db43f-4f36-4a40-8d4c-aeef44a8b274 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:52.522918 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-437db43f-4f36-4a40-8d4c-aeef44a8b274 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:52.523635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-437db43f-4f36-4a40-8d4c-aeef44a8b274 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:52.524090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-437db43f-4f36-4a40-8d4c-aeef44a8b274 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:52.524896 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-437db43f-4f36-4a40-8d4c-aeef44a8b274 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:52.532486 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-01b96254-eddc-466a-917a-d86048be1f29 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:52.543032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-01b96254-eddc-466a-917a-d86048be1f29 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:52.543581 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-01b96254-eddc-466a-917a-d86048be1f29 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:52.544773 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-01b96254-eddc-466a-917a-d86048be1f29 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.180294 Sep 03 01:36:52.545320 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 291/573] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:52 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:52.706165 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-437db43f-4f36-4a40-8d4c-aeef44a8b274 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:52.714958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-437db43f-4f36-4a40-8d4c-aeef44a8b274 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.210943 Sep 03 01:36:52.715535 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 283/574] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:52 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:53.571666 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b6e5627e-2baa-4589-9aa8-b86e75c1cb23 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:53.572265 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b6e5627e-2baa-4589-9aa8-b86e75c1cb23 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:53.578226 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6e5627e-2baa-4589-9aa8-b86e75c1cb23 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:53.578735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6e5627e-2baa-4589-9aa8-b86e75c1cb23 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:53.579168 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6e5627e-2baa-4589-9aa8-b86e75c1cb23 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:53.579853 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6e5627e-2baa-4589-9aa8-b86e75c1cb23 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:53.580294 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6e5627e-2baa-4589-9aa8-b86e75c1cb23 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:53.581503 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6e5627e-2baa-4589-9aa8-b86e75c1cb23 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:53.718201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b6e5627e-2baa-4589-9aa8-b86e75c1cb23 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:53.729256 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b6e5627e-2baa-4589-9aa8-b86e75c1cb23 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:53.730747 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b6e5627e-2baa-4589-9aa8-b86e75c1cb23 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:53.731931 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b6e5627e-2baa-4589-9aa8-b86e75c1cb23 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.164137 Sep 03 01:36:53.732536 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 292/575] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:53 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:53.740710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5f821fc5-593f-4f7c-b8de-85478a167501 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:53.742174 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5f821fc5-593f-4f7c-b8de-85478a167501 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:53.749713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5f821fc5-593f-4f7c-b8de-85478a167501 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:53.750202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5f821fc5-593f-4f7c-b8de-85478a167501 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:53.750674 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5f821fc5-593f-4f7c-b8de-85478a167501 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:53.751380 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5f821fc5-593f-4f7c-b8de-85478a167501 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:53.752010 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5f821fc5-593f-4f7c-b8de-85478a167501 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:53.753040 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5f821fc5-593f-4f7c-b8de-85478a167501 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:53.896244 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5f821fc5-593f-4f7c-b8de-85478a167501 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:53.905769 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5f821fc5-593f-4f7c-b8de-85478a167501 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.170068 Sep 03 01:36:53.906478 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 284/576] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:53 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:54.761912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-bcf0b9c8-4e9a-4df7-8eff-97d8f103d699 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:54.762664 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-bcf0b9c8-4e9a-4df7-8eff-97d8f103d699 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:54.770266 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcf0b9c8-4e9a-4df7-8eff-97d8f103d699 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:54.770876 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcf0b9c8-4e9a-4df7-8eff-97d8f103d699 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:54.771390 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcf0b9c8-4e9a-4df7-8eff-97d8f103d699 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:54.772228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcf0b9c8-4e9a-4df7-8eff-97d8f103d699 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:54.772747 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcf0b9c8-4e9a-4df7-8eff-97d8f103d699 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:54.773433 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcf0b9c8-4e9a-4df7-8eff-97d8f103d699 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:54.927586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bcf0b9c8-4e9a-4df7-8eff-97d8f103d699 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:54.930840 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4bbf4b4e-1a41-4630-98f0-6c6015435ae9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:54.931682 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4bbf4b4e-1a41-4630-98f0-6c6015435ae9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:54.938582 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bcf0b9c8-4e9a-4df7-8eff-97d8f103d699 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:54.939519 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4bbf4b4e-1a41-4630-98f0-6c6015435ae9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:54.940494 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4bbf4b4e-1a41-4630-98f0-6c6015435ae9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:54.940719 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bcf0b9c8-4e9a-4df7-8eff-97d8f103d699 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:54.941277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4bbf4b4e-1a41-4630-98f0-6c6015435ae9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:54.942370 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-bcf0b9c8-4e9a-4df7-8eff-97d8f103d699 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.184471 Sep 03 01:36:54.942508 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4bbf4b4e-1a41-4630-98f0-6c6015435ae9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:54.943136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 293/577] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:54 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:36:54.943322 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4bbf4b4e-1a41-4630-98f0-6c6015435ae9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:54.944359 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4bbf4b4e-1a41-4630-98f0-6c6015435ae9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:55.105781 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4bbf4b4e-1a41-4630-98f0-6c6015435ae9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:55.116011 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4bbf4b4e-1a41-4630-98f0-6c6015435ae9 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.189215 Sep 03 01:36:55.116867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 285/578] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:54 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:55.733329 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-981937417", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "networks": [{"uuid": "9c419ae7-3777-49c3-b6cf-a135a623993c"}]}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:55.792396 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.network.neutron [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] validate_networks() for [('9c419ae7-3777-49c3-b6cf-a135a623993c', None, None, None, None, None)] {{(pid=127552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:36:55.972280 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6554d0e3-c692-4c32-866e-0b7c0d8b1dab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:55.973019 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6554d0e3-c692-4c32-866e-0b7c0d8b1dab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:55.986890 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6554d0e3-c692-4c32-866e-0b7c0d8b1dab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:55.987513 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6554d0e3-c692-4c32-866e-0b7c0d8b1dab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:55.988306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6554d0e3-c692-4c32-866e-0b7c0d8b1dab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:55.989332 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6554d0e3-c692-4c32-866e-0b7c0d8b1dab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:55.990235 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6554d0e3-c692-4c32-866e-0b7c0d8b1dab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:55.992587 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6554d0e3-c692-4c32-866e-0b7c0d8b1dab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:56.173404 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6554d0e3-c692-4c32-866e-0b7c0d8b1dab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:56.195097 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6554d0e3-c692-4c32-866e-0b7c0d8b1dab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:56.198325 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6554d0e3-c692-4c32-866e-0b7c0d8b1dab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:56.204543 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6554d0e3-c692-4c32-866e-0b7c0d8b1dab tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.237527 Sep 03 01:36:56.204543 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 286/579] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:55 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:36:56.209154 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-71604251-91e4-45ed-87df-9ea07ce13d07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:56.209775 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-71604251-91e4-45ed-87df-9ea07ce13d07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:56.216294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-71604251-91e4-45ed-87df-9ea07ce13d07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:56.216786 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-71604251-91e4-45ed-87df-9ea07ce13d07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:56.217279 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-71604251-91e4-45ed-87df-9ea07ce13d07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:56.217967 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-71604251-91e4-45ed-87df-9ea07ce13d07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:56.218461 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-71604251-91e4-45ed-87df-9ea07ce13d07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:56.218899 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-71604251-91e4-45ed-87df-9ea07ce13d07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:56.225884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:56.312432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Flavor limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:36:56.315488 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Image limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:36:56.315488 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Flavor pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:36:56.315488 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Image pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:36:56.315488 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:36:56.330465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:56.331265 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:56.332296 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:56.334563 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:56.335429 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:56.336310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:56.386754 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Getting quotas for project efb12fa605334996a0e25888c90a108a. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:36:56.392950 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Getting quotas for user 69028bf5296541b6bfe9595d684c6567 and project efb12fa605334996a0e25888c90a108a. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:36:56.393588 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-71604251-91e4-45ed-87df-9ea07ce13d07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:56.403775 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-71604251-91e4-45ed-87df-9ea07ce13d07 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.198785 Sep 03 01:36:56.418736 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 287/580] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:56 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:56.422858 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Going to run 1 instances... {{(pid=127552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:36:56.426030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:36:56.429551 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6fc07430-e2ad-4c9e-b8c1-a91aa289483e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:56.430485 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6fc07430-e2ad-4c9e-b8c1-a91aa289483e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:56.437290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6fc07430-e2ad-4c9e-b8c1-a91aa289483e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:56.438165 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6fc07430-e2ad-4c9e-b8c1-a91aa289483e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:56.440616 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6fc07430-e2ad-4c9e-b8c1-a91aa289483e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:56.440616 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6fc07430-e2ad-4c9e-b8c1-a91aa289483e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:56.441631 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6fc07430-e2ad-4c9e-b8c1-a91aa289483e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:56.442563 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6fc07430-e2ad-4c9e-b8c1-a91aa289483e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:56.483664 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6fc07430-e2ad-4c9e-b8c1-a91aa289483e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8/ips" status: 200 len: 148 microversion: 2.1 time: 0.062951 Sep 03 01:36:56.502901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 288/581] 10.222.0.13 () {58 vars in 1248 bytes} [Sat Sep 3 01:36:56 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8/ips => generated 148 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:36:56.502901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6e2b97d5-304c-48d3-8b6b-2e2beaf2a3c0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ac82605a-b9eb-4d6d-8095-6d66e17c59c2"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:36:56.502901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6e2b97d5-304c-48d3-8b6b-2e2beaf2a3c0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:56.506756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6e2b97d5-304c-48d3-8b6b-2e2beaf2a3c0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:56.507319 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6e2b97d5-304c-48d3-8b6b-2e2beaf2a3c0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:56.507764 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6e2b97d5-304c-48d3-8b6b-2e2beaf2a3c0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:56.508554 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6e2b97d5-304c-48d3-8b6b-2e2beaf2a3c0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:56.509034 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6e2b97d5-304c-48d3-8b6b-2e2beaf2a3c0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:56.509489 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6e2b97d5-304c-48d3-8b6b-2e2beaf2a3c0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:56.578824 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7a0c1739-0add-4930-a66f-e5509252b78e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.849499 Sep 03 01:36:56.580109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 294/582] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:36:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:36:56.594927 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-60ae3fce-4c85-4e9f-acbc-2e8ce8afc094 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:56.595896 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-60ae3fce-4c85-4e9f-acbc-2e8ce8afc094 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:56.632841 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-6e2b97d5-304c-48d3-8b6b-2e2beaf2a3c0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Invalid volume: volume ac82605a-b9eb-4d6d-8095-6d66e17c59c2 is already attached to instances: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6e2b97d5-304c-48d3-8b6b-2e2beaf2a3c0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: POST /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8/os-volume_attachments HTTP/1.1 Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 74 Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:36:56.634979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:36:56.636649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:36:56.636649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:36:56.636649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:36:56.636649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:36:56.636649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:36:56.636649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:36:56.636649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:36:56.636649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:36:56.636649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:36:56.636649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Sep 03 01:36:56.636649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {"volumeAttachment": {"volumeId": "ac82605a-b9eb-4d6d-8095-6d66e17c59c2"}} Sep 03 01:36:56.636649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Invalid volume: volume ac82605a-b9eb-4d6d-8095-6d66e17c59c2 is already attached to instances: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'server_id': '0cc53030-cbc9-48c7-8b91-8e23455b23b8', 'body': {'volumeAttachment': {'volumeId': 'ac82605a-b9eb-4d6d-8095-6d66e17c59c2'}}} Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ac82605a-b9eb-4d6d-8095-6d66e17c59c2 is already attached to instances: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:36:56.637635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ac82605a-b9eb-4d6d-8095-6d66e17c59c2 is already attached to instances: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:36:56.639438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:36:56.640951 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:36:56.640951 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:36:56.640951 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:36:56.640951 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ac82605a-b9eb-4d6d-8095-6d66e17c59c2 is already attached to instances: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb Sep 03 01:36:56.640951 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:36:56.640951 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6e2b97d5-304c-48d3-8b6b-2e2beaf2a3c0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 400 to user: Invalid volume: volume ac82605a-b9eb-4d6d-8095-6d66e17c59c2 is already attached to instances: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:36:56.642161 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6e2b97d5-304c-48d3-8b6b-2e2beaf2a3c0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "POST /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.147523 Sep 03 01:36:56.646485 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 289/583] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:36:56 2022] POST /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8/os-volume_attachments => generated 174 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 03 01:36:56.655885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f9973d8c-d4f6-4b30-b126-3457ef0a73c4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:56.667327 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f9973d8c-d4f6-4b30-b126-3457ef0a73c4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:56.671600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f9973d8c-d4f6-4b30-b126-3457ef0a73c4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:56.672351 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f9973d8c-d4f6-4b30-b126-3457ef0a73c4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:56.688825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f9973d8c-d4f6-4b30-b126-3457ef0a73c4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:56.689908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f9973d8c-d4f6-4b30-b126-3457ef0a73c4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:56.690730 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f9973d8c-d4f6-4b30-b126-3457ef0a73c4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:56.691265 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f9973d8c-d4f6-4b30-b126-3457ef0a73c4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:56.697223 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-60ae3fce-4c85-4e9f-acbc-2e8ce8afc094 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:56.705024 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-60ae3fce-4c85-4e9f-acbc-2e8ce8afc094 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1218 microversion: 2.1 time: 0.114389 Sep 03 01:36:56.706466 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 295/584] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:56 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:56.753820 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f9973d8c-d4f6-4b30-b126-3457ef0a73c4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:36:57.096880 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f9973d8c-d4f6-4b30-b126-3457ef0a73c4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 204 len: 0 microversion: 2.1 time: 0.448251 Sep 03 01:36:57.098561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 290/585] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:36:56 2022] DELETE /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:36:57.106997 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0a26d81d-1234-468f-a9eb-7f617cad520a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:57.108204 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0a26d81d-1234-468f-a9eb-7f617cad520a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:57.116001 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0a26d81d-1234-468f-a9eb-7f617cad520a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:57.116861 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0a26d81d-1234-468f-a9eb-7f617cad520a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:57.117530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0a26d81d-1234-468f-a9eb-7f617cad520a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:57.118499 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0a26d81d-1234-468f-a9eb-7f617cad520a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:57.119262 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0a26d81d-1234-468f-a9eb-7f617cad520a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:57.119920 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0a26d81d-1234-468f-a9eb-7f617cad520a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:57.233010 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e31f3bf7-7381-4219-83de-bc5213786250 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:57.233773 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e31f3bf7-7381-4219-83de-bc5213786250 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:57.240572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e31f3bf7-7381-4219-83de-bc5213786250 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:57.241168 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e31f3bf7-7381-4219-83de-bc5213786250 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:57.241673 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e31f3bf7-7381-4219-83de-bc5213786250 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:57.242497 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e31f3bf7-7381-4219-83de-bc5213786250 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:57.243136 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e31f3bf7-7381-4219-83de-bc5213786250 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:57.243697 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e31f3bf7-7381-4219-83de-bc5213786250 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:57.300136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0a26d81d-1234-468f-a9eb-7f617cad520a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:57.308131 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0a26d81d-1234-468f-a9eb-7f617cad520a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1680 microversion: 2.1 time: 0.205004 Sep 03 01:36:57.308708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 296/586] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:57 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1680 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:36:57.433156 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-470a243d-471d-4ba1-b3fe-060aee7eb725 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:57.433773 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-470a243d-471d-4ba1-b3fe-060aee7eb725 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:57.440507 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-470a243d-471d-4ba1-b3fe-060aee7eb725 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:57.441026 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-470a243d-471d-4ba1-b3fe-060aee7eb725 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:57.441713 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-470a243d-471d-4ba1-b3fe-060aee7eb725 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:57.448989 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e31f3bf7-7381-4219-83de-bc5213786250 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:57.454765 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-470a243d-471d-4ba1-b3fe-060aee7eb725 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:57.456289 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-470a243d-471d-4ba1-b3fe-060aee7eb725 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:57.459030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-470a243d-471d-4ba1-b3fe-060aee7eb725 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:57.459732 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e31f3bf7-7381-4219-83de-bc5213786250 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:57.461191 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e31f3bf7-7381-4219-83de-bc5213786250 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:57.462503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e31f3bf7-7381-4219-83de-bc5213786250 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.234118 Sep 03 01:36:57.463061 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 291/587] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:57 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:57.647044 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-470a243d-471d-4ba1-b3fe-060aee7eb725 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:57.657596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-470a243d-471d-4ba1-b3fe-060aee7eb725 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.228230 Sep 03 01:36:57.658171 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 297/588] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:57 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:57.730422 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-756f524a-fa3c-4811-99c8-20e3f55984f3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:57.730954 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-756f524a-fa3c-4811-99c8-20e3f55984f3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:57.786096 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-756f524a-fa3c-4811-99c8-20e3f55984f3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:57.794162 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-756f524a-fa3c-4811-99c8-20e3f55984f3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1218 microversion: 2.1 time: 0.067713 Sep 03 01:36:57.795317 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 292/589] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:57 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:57.946478 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cf448ca3-d5f9-48df-b647-26cba623275f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:57.947010 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cf448ca3-d5f9-48df-b647-26cba623275f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:57.953548 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf448ca3-d5f9-48df-b647-26cba623275f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:57.954032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf448ca3-d5f9-48df-b647-26cba623275f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:57.954502 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf448ca3-d5f9-48df-b647-26cba623275f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:57.955192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf448ca3-d5f9-48df-b647-26cba623275f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:57.956282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf448ca3-d5f9-48df-b647-26cba623275f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:57.956784 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf448ca3-d5f9-48df-b647-26cba623275f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:58.124760 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-cf448ca3-d5f9-48df-b647-26cba623275f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lazy-loading 'services' on Instance uuid a0fef20f-3dfd-4d65-b5ed-50f3caaa011f {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:36:58.337217 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-26c772f4-9b9d-4907-9d67-fe4c5a3bb1d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:58.337866 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-26c772f4-9b9d-4907-9d67-fe4c5a3bb1d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:58.340299 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:58.347574 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-26c772f4-9b9d-4907-9d67-fe4c5a3bb1d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:58.348078 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-26c772f4-9b9d-4907-9d67-fe4c5a3bb1d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:58.348512 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-26c772f4-9b9d-4907-9d67-fe4c5a3bb1d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:58.349222 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-26c772f4-9b9d-4907-9d67-fe4c5a3bb1d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:58.349678 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-26c772f4-9b9d-4907-9d67-fe4c5a3bb1d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:58.350105 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-26c772f4-9b9d-4907-9d67-fe4c5a3bb1d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:58.354616 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:58.491478 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-26c772f4-9b9d-4907-9d67-fe4c5a3bb1d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:58.508113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-26c772f4-9b9d-4907-9d67-fe4c5a3bb1d1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1680 microversion: 2.1 time: 0.174855 Sep 03 01:36:58.522964 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 293/590] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:58 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1680 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:58.530802 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-81dfda0f-4181-48a3-9834-db28d040f323 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:58.531408 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-81dfda0f-4181-48a3-9834-db28d040f323 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:58.539465 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81dfda0f-4181-48a3-9834-db28d040f323 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:58.541277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81dfda0f-4181-48a3-9834-db28d040f323 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:58.541277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81dfda0f-4181-48a3-9834-db28d040f323 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:58.541674 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81dfda0f-4181-48a3-9834-db28d040f323 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:58.542322 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81dfda0f-4181-48a3-9834-db28d040f323 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:58.542862 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81dfda0f-4181-48a3-9834-db28d040f323 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:58.586670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cf448ca3-d5f9-48df-b647-26cba623275f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/os-volume_attachments/619e3b9a-d725-4d11-be0b-f2b54cf8eaeb" status: 202 len: 0 microversion: 2.1 time: 0.644157 Sep 03 01:36:58.593083 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 298/591] 10.222.0.13 () {58 vars in 1416 bytes} [Sat Sep 3 01:36:57 2022] DELETE /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/os-volume_attachments/619e3b9a-d725-4d11-be0b-f2b54cf8eaeb => generated 0 bytes in 646 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 01:36:58.687886 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-11ca4b64-1f64-4141-a034-b6334eaf292c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:58.688587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-11ca4b64-1f64-4141-a034-b6334eaf292c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:58.696412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-11ca4b64-1f64-4141-a034-b6334eaf292c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:58.697129 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-11ca4b64-1f64-4141-a034-b6334eaf292c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:58.697755 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-11ca4b64-1f64-4141-a034-b6334eaf292c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:58.698783 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-11ca4b64-1f64-4141-a034-b6334eaf292c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:58.699397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-11ca4b64-1f64-4141-a034-b6334eaf292c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:58.700085 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-11ca4b64-1f64-4141-a034-b6334eaf292c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:58.709479 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:36:58.774908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-81dfda0f-4181-48a3-9834-db28d040f323 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:58.792016 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-81dfda0f-4181-48a3-9834-db28d040f323 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:58.795752 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-81dfda0f-4181-48a3-9834-db28d040f323 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:58.796993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-81dfda0f-4181-48a3-9834-db28d040f323 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.272895 Sep 03 01:36:58.800980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 294/592] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:58 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:36:58.834966 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4a297e6c-0367-41fb-b9cd-b6d2086484fc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:58.835838 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4a297e6c-0367-41fb-b9cd-b6d2086484fc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:58.853430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a297e6c-0367-41fb-b9cd-b6d2086484fc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:58.853430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a297e6c-0367-41fb-b9cd-b6d2086484fc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:58.853430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a297e6c-0367-41fb-b9cd-b6d2086484fc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:58.853430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a297e6c-0367-41fb-b9cd-b6d2086484fc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:58.853897 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a297e6c-0367-41fb-b9cd-b6d2086484fc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:58.853897 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4a297e6c-0367-41fb-b9cd-b6d2086484fc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:58.911620 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-11ca4b64-1f64-4141-a034-b6334eaf292c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:58.919950 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-11ca4b64-1f64-4141-a034-b6334eaf292c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.236383 Sep 03 01:36:58.920530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 299/593] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:58 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:58.969477 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4a297e6c-0367-41fb-b9cd-b6d2086484fc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:58.979304 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4a297e6c-0367-41fb-b9cd-b6d2086484fc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1222 microversion: 2.1 time: 0.150053 Sep 03 01:36:58.980197 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 295/594] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:58 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1222 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:59.537437 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cf020d6b-05f2-40ba-bc01-2ff6c52ef57f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:59.541905 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cf020d6b-05f2-40ba-bc01-2ff6c52ef57f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:59.544209 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf020d6b-05f2-40ba-bc01-2ff6c52ef57f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:59.544696 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf020d6b-05f2-40ba-bc01-2ff6c52ef57f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:59.545134 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf020d6b-05f2-40ba-bc01-2ff6c52ef57f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:59.545829 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf020d6b-05f2-40ba-bc01-2ff6c52ef57f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:59.546416 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf020d6b-05f2-40ba-bc01-2ff6c52ef57f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:59.546844 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cf020d6b-05f2-40ba-bc01-2ff6c52ef57f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:59.693558 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cf020d6b-05f2-40ba-bc01-2ff6c52ef57f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:59.703277 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cf020d6b-05f2-40ba-bc01-2ff6c52ef57f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1680 microversion: 2.1 time: 0.170157 Sep 03 01:36:59.704211 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 300/595] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:59 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:36:59.831032 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9d1d8e8c-78f0-400c-9483-11fb2c2eb1fa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:59.831918 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9d1d8e8c-78f0-400c-9483-11fb2c2eb1fa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:59.838518 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d1d8e8c-78f0-400c-9483-11fb2c2eb1fa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:59.839006 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d1d8e8c-78f0-400c-9483-11fb2c2eb1fa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:59.839585 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d1d8e8c-78f0-400c-9483-11fb2c2eb1fa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:59.840320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d1d8e8c-78f0-400c-9483-11fb2c2eb1fa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:59.840973 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d1d8e8c-78f0-400c-9483-11fb2c2eb1fa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:59.841545 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9d1d8e8c-78f0-400c-9483-11fb2c2eb1fa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:59.943377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a5c7db3a-e674-408f-99db-2d4499215c66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:36:59.944101 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a5c7db3a-e674-408f-99db-2d4499215c66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:36:59.950270 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a5c7db3a-e674-408f-99db-2d4499215c66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:59.950904 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a5c7db3a-e674-408f-99db-2d4499215c66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:59.951599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a5c7db3a-e674-408f-99db-2d4499215c66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:59.952512 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a5c7db3a-e674-408f-99db-2d4499215c66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:36:59.953173 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a5c7db3a-e674-408f-99db-2d4499215c66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:36:59.953767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a5c7db3a-e674-408f-99db-2d4499215c66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:36:59.978524 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9d1d8e8c-78f0-400c-9483-11fb2c2eb1fa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:59.988775 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9d1d8e8c-78f0-400c-9483-11fb2c2eb1fa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:59.990218 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9d1d8e8c-78f0-400c-9483-11fb2c2eb1fa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:36:59.991700 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9d1d8e8c-78f0-400c-9483-11fb2c2eb1fa tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.165331 Sep 03 01:36:59.992359 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 296/596] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:36:59 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:37:00.013819 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1db69c4a-b9a7-47c4-afc1-245d2c2c2b78 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:00.014435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1db69c4a-b9a7-47c4-afc1-245d2c2c2b78 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:00.023246 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1db69c4a-b9a7-47c4-afc1-245d2c2c2b78 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:00.023744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1db69c4a-b9a7-47c4-afc1-245d2c2c2b78 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:00.024183 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1db69c4a-b9a7-47c4-afc1-245d2c2c2b78 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:00.024915 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1db69c4a-b9a7-47c4-afc1-245d2c2c2b78 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:00.025540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1db69c4a-b9a7-47c4-afc1-245d2c2c2b78 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:00.026178 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1db69c4a-b9a7-47c4-afc1-245d2c2c2b78 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:00.096694 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1db69c4a-b9a7-47c4-afc1-245d2c2c2b78 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:00.100142 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a5c7db3a-e674-408f-99db-2d4499215c66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:00.104748 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1db69c4a-b9a7-47c4-afc1-245d2c2c2b78 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1222 microversion: 2.1 time: 0.099304 Sep 03 01:37:00.105435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 297/597] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:00 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:00.117225 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a5c7db3a-e674-408f-99db-2d4499215c66 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.170133 Sep 03 01:37:00.117605 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 301/598] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:36:59 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:00.728408 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f7f74606-a191-413f-848d-7bc1fb2ee8d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:00.729231 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f7f74606-a191-413f-848d-7bc1fb2ee8d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:00.735245 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f7f74606-a191-413f-848d-7bc1fb2ee8d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:00.735721 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f7f74606-a191-413f-848d-7bc1fb2ee8d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:00.736163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f7f74606-a191-413f-848d-7bc1fb2ee8d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:00.737577 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f7f74606-a191-413f-848d-7bc1fb2ee8d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:00.739595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f7f74606-a191-413f-848d-7bc1fb2ee8d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:00.739595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f7f74606-a191-413f-848d-7bc1fb2ee8d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:00.887158 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-f7f74606-a191-413f-848d-7bc1fb2ee8d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:00.894924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f7f74606-a191-413f-848d-7bc1fb2ee8d8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1680 microversion: 2.1 time: 0.170415 Sep 03 01:37:00.895487 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 298/599] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:00 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1680 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:01.019609 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-dd039295-6ebf-470e-8656-03c3673a7e32 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:01.025053 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-dd039295-6ebf-470e-8656-03c3673a7e32 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:01.026554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd039295-6ebf-470e-8656-03c3673a7e32 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:01.027036 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd039295-6ebf-470e-8656-03c3673a7e32 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:01.027464 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd039295-6ebf-470e-8656-03c3673a7e32 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:01.028143 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd039295-6ebf-470e-8656-03c3673a7e32 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:01.028593 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd039295-6ebf-470e-8656-03c3673a7e32 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:01.029011 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd039295-6ebf-470e-8656-03c3673a7e32 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:01.129178 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e40a0eaa-a972-4e88-ab13-20de797633b8 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:01.129893 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e40a0eaa-a972-4e88-ab13-20de797633b8 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:01.136515 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e40a0eaa-a972-4e88-ab13-20de797633b8 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:01.137184 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e40a0eaa-a972-4e88-ab13-20de797633b8 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:01.137613 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e40a0eaa-a972-4e88-ab13-20de797633b8 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:01.138503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e40a0eaa-a972-4e88-ab13-20de797633b8 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:01.139237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e40a0eaa-a972-4e88-ab13-20de797633b8 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:01.139673 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e40a0eaa-a972-4e88-ab13-20de797633b8 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:01.203377 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e40a0eaa-a972-4e88-ab13-20de797633b8 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:01.211944 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e40a0eaa-a972-4e88-ab13-20de797633b8 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1214 microversion: 2.1 time: 0.088247 Sep 03 01:37:01.212558 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 299/600] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:01 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:01.217269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a3c5c097-a867-40b5-85d7-a0ebaa7c4ac0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:01.218156 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a3c5c097-a867-40b5-85d7-a0ebaa7c4ac0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:01.225404 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3c5c097-a867-40b5-85d7-a0ebaa7c4ac0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:01.225880 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3c5c097-a867-40b5-85d7-a0ebaa7c4ac0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:01.226534 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3c5c097-a867-40b5-85d7-a0ebaa7c4ac0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:01.227221 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3c5c097-a867-40b5-85d7-a0ebaa7c4ac0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:01.227671 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3c5c097-a867-40b5-85d7-a0ebaa7c4ac0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:01.228090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a3c5c097-a867-40b5-85d7-a0ebaa7c4ac0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:01.239635 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dd039295-6ebf-470e-8656-03c3673a7e32 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:01.248564 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dd039295-6ebf-470e-8656-03c3673a7e32 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:01.250246 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dd039295-6ebf-470e-8656-03c3673a7e32 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:01.251667 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-dd039295-6ebf-470e-8656-03c3673a7e32 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.236060 Sep 03 01:37:01.252233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 302/601] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:01 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:37:01.356771 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a3c5c097-a867-40b5-85d7-a0ebaa7c4ac0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:01.365340 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a3c5c097-a867-40b5-85d7-a0ebaa7c4ac0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.151641 Sep 03 01:37:01.365914 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 300/602] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:01 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:01.918823 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-690b1f9b-655e-44b4-a061-bd86f86ef060 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:01.919358 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-690b1f9b-655e-44b4-a061-bd86f86ef060 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:01.925965 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-690b1f9b-655e-44b4-a061-bd86f86ef060 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:01.926475 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-690b1f9b-655e-44b4-a061-bd86f86ef060 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:01.926905 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-690b1f9b-655e-44b4-a061-bd86f86ef060 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:01.927581 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-690b1f9b-655e-44b4-a061-bd86f86ef060 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:01.928026 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-690b1f9b-655e-44b4-a061-bd86f86ef060 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:01.928474 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-690b1f9b-655e-44b4-a061-bd86f86ef060 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:02.062497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-690b1f9b-655e-44b4-a061-bd86f86ef060 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:02.070867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-690b1f9b-655e-44b4-a061-bd86f86ef060 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1680 microversion: 2.1 time: 0.156126 Sep 03 01:37:02.071455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 303/603] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:01 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:02.236498 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7ae72116-7be1-4b86-8700-b12931e72d85 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:02.237977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7ae72116-7be1-4b86-8700-b12931e72d85 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:02.249320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7ae72116-7be1-4b86-8700-b12931e72d85 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:02.249818 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7ae72116-7be1-4b86-8700-b12931e72d85 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:02.250293 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7ae72116-7be1-4b86-8700-b12931e72d85 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:02.251061 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7ae72116-7be1-4b86-8700-b12931e72d85 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:02.251524 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7ae72116-7be1-4b86-8700-b12931e72d85 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:02.252543 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7ae72116-7be1-4b86-8700-b12931e72d85 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:02.278613 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b0540f06-e36b-4e12-8215-8fee03f08bc6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:02.279521 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b0540f06-e36b-4e12-8215-8fee03f08bc6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:02.289332 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b0540f06-e36b-4e12-8215-8fee03f08bc6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:02.289823 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b0540f06-e36b-4e12-8215-8fee03f08bc6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:02.294143 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b0540f06-e36b-4e12-8215-8fee03f08bc6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:02.295106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b0540f06-e36b-4e12-8215-8fee03f08bc6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:02.295911 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b0540f06-e36b-4e12-8215-8fee03f08bc6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:02.296513 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b0540f06-e36b-4e12-8215-8fee03f08bc6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:02.444502 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7ae72116-7be1-4b86-8700-b12931e72d85 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:02.452407 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7ae72116-7be1-4b86-8700-b12931e72d85 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1270 microversion: 2.1 time: 0.219972 Sep 03 01:37:02.453351 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 301/604] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:02 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1270 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:02.458729 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-3b14b2d1-cdda-4f2c-9b98-a98c5778bdb5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:02.459643 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-3b14b2d1-cdda-4f2c-9b98-a98c5778bdb5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:02.473538 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3b14b2d1-cdda-4f2c-9b98-a98c5778bdb5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:02.474034 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3b14b2d1-cdda-4f2c-9b98-a98c5778bdb5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:02.474708 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3b14b2d1-cdda-4f2c-9b98-a98c5778bdb5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:02.480677 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3b14b2d1-cdda-4f2c-9b98-a98c5778bdb5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:02.480837 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3b14b2d1-cdda-4f2c-9b98-a98c5778bdb5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:02.481276 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3b14b2d1-cdda-4f2c-9b98-a98c5778bdb5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:02.542621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b0540f06-e36b-4e12-8215-8fee03f08bc6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:02.556792 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b0540f06-e36b-4e12-8215-8fee03f08bc6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:02.561916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b0540f06-e36b-4e12-8215-8fee03f08bc6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:02.563427 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b0540f06-e36b-4e12-8215-8fee03f08bc6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.289953 Sep 03 01:37:02.564413 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 304/605] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:02 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:37:02.689552 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-3b14b2d1-cdda-4f2c-9b98-a98c5778bdb5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:02.702538 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-3b14b2d1-cdda-4f2c-9b98-a98c5778bdb5 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.243673 Sep 03 01:37:02.702538 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 302/606] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:02 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:03.098576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-4c4ead53-ee53-4099-a110-4ba5a53d07d0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:03.099981 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-4c4ead53-ee53-4099-a110-4ba5a53d07d0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:03.107805 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4c4ead53-ee53-4099-a110-4ba5a53d07d0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:03.108848 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4c4ead53-ee53-4099-a110-4ba5a53d07d0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:03.109459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4c4ead53-ee53-4099-a110-4ba5a53d07d0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:03.110395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4c4ead53-ee53-4099-a110-4ba5a53d07d0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:03.111134 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4c4ead53-ee53-4099-a110-4ba5a53d07d0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:03.111767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4c4ead53-ee53-4099-a110-4ba5a53d07d0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:03.477763 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2f92638e-3e8d-4cd7-afbb-ea840b294d6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:03.478914 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2f92638e-3e8d-4cd7-afbb-ea840b294d6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:03.489914 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2f92638e-3e8d-4cd7-afbb-ea840b294d6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:03.490614 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2f92638e-3e8d-4cd7-afbb-ea840b294d6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:03.491171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2f92638e-3e8d-4cd7-afbb-ea840b294d6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:03.492503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2f92638e-3e8d-4cd7-afbb-ea840b294d6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:03.493064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2f92638e-3e8d-4cd7-afbb-ea840b294d6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:03.493588 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2f92638e-3e8d-4cd7-afbb-ea840b294d6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:03.556847 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-4c4ead53-ee53-4099-a110-4ba5a53d07d0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:03.565709 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2f92638e-3e8d-4cd7-afbb-ea840b294d6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:03.572174 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-4c4ead53-ee53-4099-a110-4ba5a53d07d0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1680 microversion: 2.1 time: 0.480757 Sep 03 01:37:03.572769 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 305/607] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:03 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1680 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:03.586739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2f92638e-3e8d-4cd7-afbb-ea840b294d6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1270 microversion: 2.1 time: 0.101774 Sep 03 01:37:03.586739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 303/608] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:03 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1270 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:03.593086 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-31cc2e61-df75-42ff-a412-7792a3df31c6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:03.593795 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-31cc2e61-df75-42ff-a412-7792a3df31c6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:03.601607 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-31cc2e61-df75-42ff-a412-7792a3df31c6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:03.602149 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-31cc2e61-df75-42ff-a412-7792a3df31c6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:03.602613 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-31cc2e61-df75-42ff-a412-7792a3df31c6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:03.603331 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-31cc2e61-df75-42ff-a412-7792a3df31c6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:03.603789 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-31cc2e61-df75-42ff-a412-7792a3df31c6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:03.604214 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-31cc2e61-df75-42ff-a412-7792a3df31c6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:03.726468 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-51c167ad-1e65-43a6-ae39-cbe59c4826ae tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:03.727636 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-51c167ad-1e65-43a6-ae39-cbe59c4826ae tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:03.739190 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51c167ad-1e65-43a6-ae39-cbe59c4826ae tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:03.739926 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51c167ad-1e65-43a6-ae39-cbe59c4826ae tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:03.740566 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51c167ad-1e65-43a6-ae39-cbe59c4826ae tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:03.741689 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51c167ad-1e65-43a6-ae39-cbe59c4826ae tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:03.742540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51c167ad-1e65-43a6-ae39-cbe59c4826ae tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:03.743158 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51c167ad-1e65-43a6-ae39-cbe59c4826ae tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:04.130612 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-31cc2e61-df75-42ff-a412-7792a3df31c6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:04.147600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-31cc2e61-df75-42ff-a412-7792a3df31c6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:04.149258 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-31cc2e61-df75-42ff-a412-7792a3df31c6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:04.150672 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-31cc2e61-df75-42ff-a412-7792a3df31c6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.562653 Sep 03 01:37:04.166501 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-51c167ad-1e65-43a6-ae39-cbe59c4826ae tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:04.167560 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 304/609] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:03 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:37:04.217272 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-51c167ad-1e65-43a6-ae39-cbe59c4826ae tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.492761 Sep 03 01:37:04.218764 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 306/610] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:03 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:04.520471 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-78c50050-9d8f-499f-9f3e-4710489c7a8b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:04.520471 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-78c50050-9d8f-499f-9f3e-4710489c7a8b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:04.520471 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-78c50050-9d8f-499f-9f3e-4710489c7a8b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:04.520471 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-78c50050-9d8f-499f-9f3e-4710489c7a8b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:04.521311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-78c50050-9d8f-499f-9f3e-4710489c7a8b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:04.521311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-78c50050-9d8f-499f-9f3e-4710489c7a8b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:04.521311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-78c50050-9d8f-499f-9f3e-4710489c7a8b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:04.521311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-78c50050-9d8f-499f-9f3e-4710489c7a8b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:04.600205 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e0a6d7ae-4d98-4622-ba50-0e96d80484a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:04.600846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e0a6d7ae-4d98-4622-ba50-0e96d80484a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:04.613284 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0a6d7ae-4d98-4622-ba50-0e96d80484a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:04.613788 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0a6d7ae-4d98-4622-ba50-0e96d80484a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:04.614228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0a6d7ae-4d98-4622-ba50-0e96d80484a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:04.621201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0a6d7ae-4d98-4622-ba50-0e96d80484a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:04.622615 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0a6d7ae-4d98-4622-ba50-0e96d80484a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:04.623650 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0a6d7ae-4d98-4622-ba50-0e96d80484a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:04.763837 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e0a6d7ae-4d98-4622-ba50-0e96d80484a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:04.774098 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e0a6d7ae-4d98-4622-ba50-0e96d80484a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1288 microversion: 2.1 time: 0.178299 Sep 03 01:37:04.775746 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 307/611] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:04 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1288 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:04.783087 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0f544578-199a-4d9c-bd1e-e4b7f8a1b525 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:04.784771 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0f544578-199a-4d9c-bd1e-e4b7f8a1b525 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:04.797789 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f544578-199a-4d9c-bd1e-e4b7f8a1b525 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:04.798426 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f544578-199a-4d9c-bd1e-e4b7f8a1b525 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:04.815738 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f544578-199a-4d9c-bd1e-e4b7f8a1b525 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:04.815738 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f544578-199a-4d9c-bd1e-e4b7f8a1b525 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:04.815738 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f544578-199a-4d9c-bd1e-e4b7f8a1b525 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:04.815738 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f544578-199a-4d9c-bd1e-e4b7f8a1b525 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:04.946707 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0f544578-199a-4d9c-bd1e-e4b7f8a1b525 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:04.959603 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0f544578-199a-4d9c-bd1e-e4b7f8a1b525 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1612 microversion: 2.1 time: 0.182241 Sep 03 01:37:04.960776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 308/612] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:04 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1612 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:04.990117 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-fe5d9f96-6e7a-4dc7-ab69-b790d08882b0 req-a026d113-f793-4291-8dc3-ee3f58ad1e96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0cc53030-cbc9-48c7-8b91-8e23455b23b8", "name": "network-vif-deleted", "tag": "d96cd46a-c8f7-49a5-bfb9-dda260e9c70a"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:04.990219 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-78c50050-9d8f-499f-9f3e-4710489c7a8b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:04.990821 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-fe5d9f96-6e7a-4dc7-ab69-b790d08882b0 req-a026d113-f793-4291-8dc3-ee3f58ad1e96 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:04.992115 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-fe5d9f96-6e7a-4dc7-ab69-b790d08882b0 req-a026d113-f793-4291-8dc3-ee3f58ad1e96 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:04.992718 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-fe5d9f96-6e7a-4dc7-ab69-b790d08882b0 req-a026d113-f793-4291-8dc3-ee3f58ad1e96 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:05.000226 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-78c50050-9d8f-499f-9f3e-4710489c7a8b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1595 microversion: 2.1 time: 0.523815 Sep 03 01:37:05.000967 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 305/613] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:04 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1595 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:05.030022 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-fe5d9f96-6e7a-4dc7-ab69-b790d08882b0 req-a026d113-f793-4291-8dc3-ee3f58ad1e96 service nova] Creating event network-vif-deleted:d96cd46a-c8f7-49a5-bfb9-dda260e9c70a for instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 on hv-cinder-83800 Sep 03 01:37:05.036025 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-fe5d9f96-6e7a-4dc7-ab69-b790d08882b0 req-a026d113-f793-4291-8dc3-ee3f58ad1e96 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072890 Sep 03 01:37:05.036925 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 309/614] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:05.179429 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-954d3e89-fb99-44c8-9660-51f565b751fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:05.180278 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-954d3e89-fb99-44c8-9660-51f565b751fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:05.187311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-954d3e89-fb99-44c8-9660-51f565b751fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:05.188136 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-954d3e89-fb99-44c8-9660-51f565b751fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:05.188780 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-954d3e89-fb99-44c8-9660-51f565b751fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:05.190177 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-954d3e89-fb99-44c8-9660-51f565b751fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:05.190544 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-954d3e89-fb99-44c8-9660-51f565b751fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:05.190968 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-954d3e89-fb99-44c8-9660-51f565b751fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:05.253898 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-879ba4dd-8866-4c3e-8b51-4d66c74e08cc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:05.257711 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-879ba4dd-8866-4c3e-8b51-4d66c74e08cc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:05.274931 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-879ba4dd-8866-4c3e-8b51-4d66c74e08cc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:05.275425 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-879ba4dd-8866-4c3e-8b51-4d66c74e08cc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:05.276854 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-879ba4dd-8866-4c3e-8b51-4d66c74e08cc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:05.280535 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-879ba4dd-8866-4c3e-8b51-4d66c74e08cc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:05.283831 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-879ba4dd-8866-4c3e-8b51-4d66c74e08cc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:05.284997 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-879ba4dd-8866-4c3e-8b51-4d66c74e08cc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:05.412249 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-954d3e89-fb99-44c8-9660-51f565b751fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:05.422988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-954d3e89-fb99-44c8-9660-51f565b751fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:05.424846 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-954d3e89-fb99-44c8-9660-51f565b751fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:05.427098 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-954d3e89-fb99-44c8-9660-51f565b751fe tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.251215 Sep 03 01:37:05.448798 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 306/615] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:05 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:37:05.537710 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-879ba4dd-8866-4c3e-8b51-4d66c74e08cc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:05.547013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-879ba4dd-8866-4c3e-8b51-4d66c74e08cc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.299903 Sep 03 01:37:05.568173 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 310/616] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:05 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:05.805973 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a076a73e-372b-434b-84ee-23af6bd26e98 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:05.806702 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a076a73e-372b-434b-84ee-23af6bd26e98 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:05.816790 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a076a73e-372b-434b-84ee-23af6bd26e98 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:05.827087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a076a73e-372b-434b-84ee-23af6bd26e98 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:05.831126 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a076a73e-372b-434b-84ee-23af6bd26e98 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:05.831126 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a076a73e-372b-434b-84ee-23af6bd26e98 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:05.831126 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a076a73e-372b-434b-84ee-23af6bd26e98 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:05.831126 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a076a73e-372b-434b-84ee-23af6bd26e98 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:05.984139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d1346af1-8ad0-45e4-a6cc-c170a477aecb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:05.984820 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d1346af1-8ad0-45e4-a6cc-c170a477aecb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:05.999744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a076a73e-372b-434b-84ee-23af6bd26e98 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:06.007117 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d1346af1-8ad0-45e4-a6cc-c170a477aecb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:06.009287 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d1346af1-8ad0-45e4-a6cc-c170a477aecb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:06.010154 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a076a73e-372b-434b-84ee-23af6bd26e98 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1276 microversion: 2.1 time: 0.214804 Sep 03 01:37:06.010780 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 307/617] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:05 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1276 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:06.011315 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d1346af1-8ad0-45e4-a6cc-c170a477aecb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:06.014622 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d1346af1-8ad0-45e4-a6cc-c170a477aecb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:06.015277 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d1346af1-8ad0-45e4-a6cc-c170a477aecb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:06.015894 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d1346af1-8ad0-45e4-a6cc-c170a477aecb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:06.125992 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d1346af1-8ad0-45e4-a6cc-c170a477aecb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:06.142161 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d1346af1-8ad0-45e4-a6cc-c170a477aecb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1326 microversion: 2.1 time: 0.161952 Sep 03 01:37:06.143504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 311/618] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:05 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1326 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:06.267169 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-fe87d1b0-c0f9-4ffe-af48-91d4742ded9c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:06.276130 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fe87d1b0-c0f9-4ffe-af48-91d4742ded9c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:06.276829 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fe87d1b0-c0f9-4ffe-af48-91d4742ded9c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:06.277923 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fe87d1b0-c0f9-4ffe-af48-91d4742ded9c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:06.407564 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-fe87d1b0-c0f9-4ffe-af48-91d4742ded9c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Going to try to stop instance {{(pid=127553) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 03 01:37:06.457009 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e55ea206-3760-4623-b195-06d6a2698890 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:06.458719 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e55ea206-3760-4623-b195-06d6a2698890 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:06.473048 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:06.474923 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e55ea206-3760-4623-b195-06d6a2698890 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:06.475599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e55ea206-3760-4623-b195-06d6a2698890 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:06.476586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e55ea206-3760-4623-b195-06d6a2698890 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:06.478621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e55ea206-3760-4623-b195-06d6a2698890 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:06.478743 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e55ea206-3760-4623-b195-06d6a2698890 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:06.479430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e55ea206-3760-4623-b195-06d6a2698890 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:06.638249 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:06.701840 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=8 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:06.754793 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-fe87d1b0-c0f9-4ffe-af48-91d4742ded9c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "POST /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/action" status: 202 len: 0 microversion: 2.1 time: 0.490452 Sep 03 01:37:06.761364 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 308/619] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:37:06 2022] POST /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/action => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:37:06.804881 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e46a8a9c-914f-4973-9598-ab2b9c430e06 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:06.809782 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e46a8a9c-914f-4973-9598-ab2b9c430e06 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:06.823483 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e46a8a9c-914f-4973-9598-ab2b9c430e06 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:06.825072 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e46a8a9c-914f-4973-9598-ab2b9c430e06 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:06.825072 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e46a8a9c-914f-4973-9598-ab2b9c430e06 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:06.825276 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e46a8a9c-914f-4973-9598-ab2b9c430e06 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:06.833845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e46a8a9c-914f-4973-9598-ab2b9c430e06 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:06.834309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e46a8a9c-914f-4973-9598-ab2b9c430e06 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:07.053961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e55ea206-3760-4623-b195-06d6a2698890 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:07.065884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e55ea206-3760-4623-b195-06d6a2698890 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:07.067449 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e55ea206-3760-4623-b195-06d6a2698890 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:07.078499 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e55ea206-3760-4623-b195-06d6a2698890 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.625229 Sep 03 01:37:07.080800 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 312/620] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:06 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:37:07.087439 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-436cb45a-473a-4330-8783-bc3ac5f3963e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:07.088306 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-436cb45a-473a-4330-8783-bc3ac5f3963e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:07.102308 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-436cb45a-473a-4330-8783-bc3ac5f3963e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:07.115264 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-436cb45a-473a-4330-8783-bc3ac5f3963e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:07.116618 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-436cb45a-473a-4330-8783-bc3ac5f3963e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:07.118987 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-436cb45a-473a-4330-8783-bc3ac5f3963e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:07.120557 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-436cb45a-473a-4330-8783-bc3ac5f3963e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:07.123555 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-436cb45a-473a-4330-8783-bc3ac5f3963e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:07.270940 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e46a8a9c-914f-4973-9598-ab2b9c430e06 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:07.287433 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e46a8a9c-914f-4973-9598-ab2b9c430e06 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.524140 Sep 03 01:37:07.290562 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 309/621] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:06 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:07.300915 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2673fdfd-73f3-4308-89d0-3b9fcb6f76a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:07.302131 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2673fdfd-73f3-4308-89d0-3b9fcb6f76a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:07.316102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2673fdfd-73f3-4308-89d0-3b9fcb6f76a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:07.317036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2673fdfd-73f3-4308-89d0-3b9fcb6f76a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:07.319130 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2673fdfd-73f3-4308-89d0-3b9fcb6f76a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:07.320506 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2673fdfd-73f3-4308-89d0-3b9fcb6f76a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:07.321820 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2673fdfd-73f3-4308-89d0-3b9fcb6f76a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:07.322502 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2673fdfd-73f3-4308-89d0-3b9fcb6f76a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:07.446099 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-436cb45a-473a-4330-8783-bc3ac5f3963e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:07.458105 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-436cb45a-473a-4330-8783-bc3ac5f3963e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1679 microversion: 2.1 time: 0.374318 Sep 03 01:37:07.459939 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 313/622] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:07 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1679 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:07.468805 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:07.470408 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:07.487965 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:07.489487 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:07.490298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:07.494144 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:07.495234 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:07.495983 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:07.548861 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:07.549525 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:07.550028 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:07.550585 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lazy-loading 'fault' on Instance uuid 0cc53030-cbc9-48c7-8b91-8e23455b23b8 {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:37:07.775018 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:07.785841 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d739838c-6e12-47b1-93d5-a4bb256d5cfc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1331 microversion: 2.1 time: 0.322142 Sep 03 01:37:07.794628 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:07.811240 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 314/623] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:07 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1331 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:07.929761 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2673fdfd-73f3-4308-89d0-3b9fcb6f76a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:07.940853 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2673fdfd-73f3-4308-89d0-3b9fcb6f76a6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1318 microversion: 2.1 time: 0.648381 Sep 03 01:37:07.945135 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 310/624] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:07 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1318 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:08.110057 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ef46f39d-dc30-402d-9841-78c5f0b5a754 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:08.110854 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ef46f39d-dc30-402d-9841-78c5f0b5a754 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:08.123305 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef46f39d-dc30-402d-9841-78c5f0b5a754 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:08.125513 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef46f39d-dc30-402d-9841-78c5f0b5a754 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:08.126066 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef46f39d-dc30-402d-9841-78c5f0b5a754 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:08.128627 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef46f39d-dc30-402d-9841-78c5f0b5a754 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:08.129623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef46f39d-dc30-402d-9841-78c5f0b5a754 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:08.130305 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef46f39d-dc30-402d-9841-78c5f0b5a754 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:08.318069 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-98be5dcc-7f81-4c1b-bfbe-bfd8e5cbbc27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:08.323373 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-98be5dcc-7f81-4c1b-bfbe-bfd8e5cbbc27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:08.330021 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-98be5dcc-7f81-4c1b-bfbe-bfd8e5cbbc27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:08.338091 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-98be5dcc-7f81-4c1b-bfbe-bfd8e5cbbc27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:08.338818 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-98be5dcc-7f81-4c1b-bfbe-bfd8e5cbbc27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:08.339994 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-98be5dcc-7f81-4c1b-bfbe-bfd8e5cbbc27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:08.340671 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-98be5dcc-7f81-4c1b-bfbe-bfd8e5cbbc27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:08.341296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-98be5dcc-7f81-4c1b-bfbe-bfd8e5cbbc27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:08.412060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ef46f39d-dc30-402d-9841-78c5f0b5a754 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:08.485473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ef46f39d-dc30-402d-9841-78c5f0b5a754 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:08.492111 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ef46f39d-dc30-402d-9841-78c5f0b5a754 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:08.497452 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ef46f39d-dc30-402d-9841-78c5f0b5a754 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.391297 Sep 03 01:37:08.522377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 315/625] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:08 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:37:08.534408 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cad17376-364e-476e-8ffd-ff66c5424439 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:08.541573 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cad17376-364e-476e-8ffd-ff66c5424439 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:08.559775 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cad17376-364e-476e-8ffd-ff66c5424439 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:08.560285 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cad17376-364e-476e-8ffd-ff66c5424439 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:08.560729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cad17376-364e-476e-8ffd-ff66c5424439 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:08.561456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cad17376-364e-476e-8ffd-ff66c5424439 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:08.561914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cad17376-364e-476e-8ffd-ff66c5424439 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:08.562372 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cad17376-364e-476e-8ffd-ff66c5424439 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:08.577551 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:08.850844 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cad17376-364e-476e-8ffd-ff66c5424439 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:08.860096 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cad17376-364e-476e-8ffd-ff66c5424439 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1679 microversion: 2.1 time: 0.350032 Sep 03 01:37:08.861980 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 316/626] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:08 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1679 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:08.875912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:08.879124 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:08.891682 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:08.894062 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:08.894674 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:08.903046 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:08.905475 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:08.905990 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:08.908831 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:08.919466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-98be5dcc-7f81-4c1b-bfbe-bfd8e5cbbc27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:08.936774 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-98be5dcc-7f81-4c1b-bfbe-bfd8e5cbbc27 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1735 microversion: 2.1 time: 0.616410 Sep 03 01:37:08.937641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 311/627] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:08 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1735 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:08.971734 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8a054a96-dd4b-40df-8619-ebcc90780879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:08.971734 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8a054a96-dd4b-40df-8619-ebcc90780879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:08.988717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a054a96-dd4b-40df-8619-ebcc90780879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:08.989219 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a054a96-dd4b-40df-8619-ebcc90780879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:08.989665 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a054a96-dd4b-40df-8619-ebcc90780879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:08.993781 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a054a96-dd4b-40df-8619-ebcc90780879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:08.998570 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a054a96-dd4b-40df-8619-ebcc90780879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:08.999060 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8a054a96-dd4b-40df-8619-ebcc90780879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:08.999653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:09.001287 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:09.004432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:09.005104 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lazy-loading 'fault' on Instance uuid 0cc53030-cbc9-48c7-8b91-8e23455b23b8 {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:37:09.443444 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:09.451459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e36d794b-2564-4aeb-a2f9-3259fb075e9a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 200 len: 1331 microversion: 2.1 time: 0.587927 Sep 03 01:37:09.452580 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 317/628] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:08 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 1331 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:09.466531 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-867b604c-366f-4f34-8c7a-f3f6960322a4 req-62a94965-d3c6-42e8-9450-c627d303afcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5df2d41-c884-4178-9a70-150c16cf1c5f", "tag": "f1b93106-790d-4f9d-9fae-cd59eef8bc20"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:09.481759 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-867b604c-366f-4f34-8c7a-f3f6960322a4 req-62a94965-d3c6-42e8-9450-c627d303afcf service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:09.482654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-867b604c-366f-4f34-8c7a-f3f6960322a4 req-62a94965-d3c6-42e8-9450-c627d303afcf service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:09.483277 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-867b604c-366f-4f34-8c7a-f3f6960322a4 req-62a94965-d3c6-42e8-9450-c627d303afcf service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:09.497307 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-867b604c-366f-4f34-8c7a-f3f6960322a4 req-62a94965-d3c6-42e8-9450-c627d303afcf service nova] Creating event network-changed:f1b93106-790d-4f9d-9fae-cd59eef8bc20 for instance e5df2d41-c884-4178-9a70-150c16cf1c5f on hv-cinder-83800 Sep 03 01:37:09.508247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-867b604c-366f-4f34-8c7a-f3f6960322a4 req-62a94965-d3c6-42e8-9450-c627d303afcf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054178 Sep 03 01:37:09.508747 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 318/629] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:09.540501 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-1eac6f9a-b766-4390-9e47-ab520e485b57 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:09.541221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-1eac6f9a-b766-4390-9e47-ab520e485b57 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:09.551247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1eac6f9a-b766-4390-9e47-ab520e485b57 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:09.551747 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1eac6f9a-b766-4390-9e47-ab520e485b57 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:09.552184 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1eac6f9a-b766-4390-9e47-ab520e485b57 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:09.552890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1eac6f9a-b766-4390-9e47-ab520e485b57 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:09.553337 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1eac6f9a-b766-4390-9e47-ab520e485b57 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:09.554940 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1eac6f9a-b766-4390-9e47-ab520e485b57 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:09.637155 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8a054a96-dd4b-40df-8619-ebcc90780879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:09.643180 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8a054a96-dd4b-40df-8619-ebcc90780879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1318 microversion: 2.1 time: 0.681574 Sep 03 01:37:09.661471 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 312/630] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:08 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1318 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:09.878569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-36d4f2bc-7314-4265-9e24-78ffbed83a81 req-61f82981-cf83-4259-993a-b586f74c5465 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51ed6fe4-9955-4b04-b20d-b2f60e944310", "tag": "91fcf0db-d435-4413-9523-d181eb8e1ae2"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:09.895739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-36d4f2bc-7314-4265-9e24-78ffbed83a81 req-61f82981-cf83-4259-993a-b586f74c5465 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:09.896595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-36d4f2bc-7314-4265-9e24-78ffbed83a81 req-61f82981-cf83-4259-993a-b586f74c5465 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:09.897208 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-36d4f2bc-7314-4265-9e24-78ffbed83a81 req-61f82981-cf83-4259-993a-b586f74c5465 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:09.913989 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-36d4f2bc-7314-4265-9e24-78ffbed83a81 req-61f82981-cf83-4259-993a-b586f74c5465 service nova] Creating event network-changed:91fcf0db-d435-4413-9523-d181eb8e1ae2 for instance 51ed6fe4-9955-4b04-b20d-b2f60e944310 on hv-cinder-83800 Sep 03 01:37:09.918731 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1eac6f9a-b766-4390-9e47-ab520e485b57 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:09.920488 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-36d4f2bc-7314-4265-9e24-78ffbed83a81 req-61f82981-cf83-4259-993a-b586f74c5465 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048063 Sep 03 01:37:09.921281 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 313/631] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:37:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:37:09.929765 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6f461e0f-da7e-4b94-a7a4-eac09810190f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:09.930444 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1eac6f9a-b766-4390-9e47-ab520e485b57 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:09.932052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6f461e0f-da7e-4b94-a7a4-eac09810190f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:09.936015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1eac6f9a-b766-4390-9e47-ab520e485b57 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:09.937559 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-1eac6f9a-b766-4390-9e47-ab520e485b57 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.402407 Sep 03 01:37:09.938848 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 319/632] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:09 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:37:09.948759 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6f461e0f-da7e-4b94-a7a4-eac09810190f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:09.949309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6f461e0f-da7e-4b94-a7a4-eac09810190f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:09.949689 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6f461e0f-da7e-4b94-a7a4-eac09810190f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:09.950579 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6f461e0f-da7e-4b94-a7a4-eac09810190f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:09.951610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6f461e0f-da7e-4b94-a7a4-eac09810190f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:09.956169 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6f461e0f-da7e-4b94-a7a4-eac09810190f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:09.968954 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-56a0dc10-b45d-4451-8996-ac53e45809d1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:09.969912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-56a0dc10-b45d-4451-8996-ac53e45809d1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:09.978820 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-56a0dc10-b45d-4451-8996-ac53e45809d1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:09.979678 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-56a0dc10-b45d-4451-8996-ac53e45809d1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:09.983473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-56a0dc10-b45d-4451-8996-ac53e45809d1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:09.996239 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-56a0dc10-b45d-4451-8996-ac53e45809d1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:09.998060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-56a0dc10-b45d-4451-8996-ac53e45809d1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:09.999965 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-56a0dc10-b45d-4451-8996-ac53e45809d1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:10.356584 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-56a0dc10-b45d-4451-8996-ac53e45809d1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:10.370938 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-56a0dc10-b45d-4451-8996-ac53e45809d1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1715 microversion: 2.1 time: 0.404831 Sep 03 01:37:10.372195 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 320/633] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:09 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1715 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:10.394492 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6f461e0f-da7e-4b94-a7a4-eac09810190f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:10.414370 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6f461e0f-da7e-4b94-a7a4-eac09810190f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1679 microversion: 2.1 time: 0.491519 Sep 03 01:37:10.415269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 314/634] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:09 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1679 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:10.485457 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-72366788-983f-44fb-b8e4-f6c7753eb7b0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:10.487667 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-72366788-983f-44fb-b8e4-f6c7753eb7b0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:10.500393 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72366788-983f-44fb-b8e4-f6c7753eb7b0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:10.513996 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72366788-983f-44fb-b8e4-f6c7753eb7b0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:10.515677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72366788-983f-44fb-b8e4-f6c7753eb7b0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:10.516804 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72366788-983f-44fb-b8e4-f6c7753eb7b0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:10.517981 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72366788-983f-44fb-b8e4-f6c7753eb7b0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:10.518741 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72366788-983f-44fb-b8e4-f6c7753eb7b0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:10.530592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d57551ce-8d66-4239-a603-53861908774c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:10.531087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d57551ce-8d66-4239-a603-53861908774c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:10.538534 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d57551ce-8d66-4239-a603-53861908774c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:10.541177 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d57551ce-8d66-4239-a603-53861908774c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:10.541809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d57551ce-8d66-4239-a603-53861908774c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:10.543277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d57551ce-8d66-4239-a603-53861908774c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:10.544983 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d57551ce-8d66-4239-a603-53861908774c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:10.546247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-72366788-983f-44fb-b8e4-f6c7753eb7b0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:37:10.546939 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d57551ce-8d66-4239-a603-53861908774c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-72366788-983f-44fb-b8e4-f6c7753eb7b0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 HTTP/1.1 Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:37:10.549700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:37:10.551380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:37:10.551380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:37:10.551380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:37:10.551380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:37:10.551380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:37:10.551380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:37:10.551380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:37:10.551380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:37:10.551380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:37:10.551380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:37:10.551380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:37:10.551380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '0cc53030-cbc9-48c7-8b91-8e23455b23b8'} Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:37:10.552217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:37:10.553428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:37:10.554527 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-72366788-983f-44fb-b8e4-f6c7753eb7b0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 404 to user: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:37:10.554527 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-72366788-983f-44fb-b8e4-f6c7753eb7b0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 404 len: 111 microversion: 2.1 time: 0.074104 Sep 03 01:37:10.554527 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 321/635] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:10 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 01:37:10.569221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5a27caee-46c0-4af1-96ff-b8b1efa66cbc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '.version_select at 0x7f6d24ce2310>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:10.659354 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5a27caee-46c0-4af1-96ff-b8b1efa66cbc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023371268" status: 202 len: 0 microversion: 2.1 time: 0.102384 Sep 03 01:37:10.660479 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 322/636] 10.222.0.13 () {58 vars in 1221 bytes} [Sat Sep 3 01:37:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1023371268 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:37:10.669563 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c02cdbf8-a0ea-4975-86ae-f0ae37027d6b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:10.671354 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c02cdbf8-a0ea-4975-86ae-f0ae37027d6b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:10.693316 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c02cdbf8-a0ea-4975-86ae-f0ae37027d6b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:10.693725 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c02cdbf8-a0ea-4975-86ae-f0ae37027d6b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:10.694329 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c02cdbf8-a0ea-4975-86ae-f0ae37027d6b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:10.695108 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c02cdbf8-a0ea-4975-86ae-f0ae37027d6b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:10.695582 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c02cdbf8-a0ea-4975-86ae-f0ae37027d6b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:10.696218 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c02cdbf8-a0ea-4975-86ae-f0ae37027d6b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:10.809697 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-d57551ce-8d66-4239-a603-53861908774c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] HTTP exception thrown: Cannot 'detach_volume' instance 34abe46a-5361-4e96-a952-5909fad8c4f4 while it is in vm_state rescued Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d57551ce-8d66-4239-a603-53861908774c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Request method failure captured: Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: DELETE /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments/cd3cadc2-09f0-44f4-a795-81470d7fe18c HTTP/1.1 Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7V2ath9gf-whD6tL86b1S7pYvql4QgUyJF1yPAVzgiQ2t6IoM2RYz54SA6JROlCBu6uMndk0hzOd9Xac4ZVRZsWa_GZPp5YK22x3_vfwipYUfM5-C8aj-iUUgX169mfrwWeU8PgX6mea_qND-4fnQAWZMLQqNrq4pPhzc49V3gV8w Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: d93c5a3ef20c4a5b87af4803f820b60e Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:37:10.813970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:37:10.816228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:37:10.816228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:37:10.816228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: d93c5a3ef20c4a5b87af4803f820b60e Sep 03 01:37:10.816228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:37:10.816228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-ServerRescueNegativeTestJSON-201019967-project Sep 03 01:37:10.816228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:37:10.816228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:37:10.816228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 409c324dca974d9dad9529b2a0d82b30 Sep 03 01:37:10.816228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201019967-project Sep 03 01:37:10.816228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:37:10.816228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Cannot 'detach_volume' instance 34abe46a-5361-4e96-a952-5909fad8c4f4 while it is in vm_state rescued Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'server_id': '34abe46a-5361-4e96-a952-5909fad8c4f4', 'id': 'cd3cadc2-09f0-44f4-a795-81470d7fe18c'} Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 34abe46a-5361-4e96-a952-5909fad8c4f4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:37:10.816925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 34abe46a-5361-4e96-a952-5909fad8c4f4 while it is in vm_state rescued Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 34abe46a-5361-4e96-a952-5909fad8c4f4 while it is in vm_state rescued Sep 03 01:37:10.818320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:37:10.819439 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d57551ce-8d66-4239-a603-53861908774c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Returning 409 to user: Cannot 'detach_volume' instance 34abe46a-5361-4e96-a952-5909fad8c4f4 while it is in vm_state rescued {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:37:10.827647 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d57551ce-8d66-4239-a603-53861908774c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments/cd3cadc2-09f0-44f4-a795-81470d7fe18c" status: 409 len: 152 microversion: 2.1 time: 0.294320 Sep 03 01:37:10.832235 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 315/637] 10.222.0.13 () {58 vars in 1416 bytes} [Sat Sep 3 01:37:10 2022] DELETE /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments/cd3cadc2-09f0-44f4-a795-81470d7fe18c => generated 152 bytes in 306 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 03 01:37:10.838693 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-711b31d0-de7f-4dc3-9cf4-b2a6b899e3f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:10.839302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-711b31d0-de7f-4dc3-9cf4-b2a6b899e3f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:10.846202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-711b31d0-de7f-4dc3-9cf4-b2a6b899e3f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:10.846736 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-711b31d0-de7f-4dc3-9cf4-b2a6b899e3f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:10.847175 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-711b31d0-de7f-4dc3-9cf4-b2a6b899e3f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:10.847930 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-711b31d0-de7f-4dc3-9cf4-b2a6b899e3f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:10.848384 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-711b31d0-de7f-4dc3-9cf4-b2a6b899e3f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:10.848812 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-711b31d0-de7f-4dc3-9cf4-b2a6b899e3f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:11.080769 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c02cdbf8-a0ea-4975-86ae-f0ae37027d6b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:11.089229 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-711b31d0-de7f-4dc3-9cf4-b2a6b899e3f1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "POST /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/action" status: 202 len: 0 microversion: 2.1 time: 0.255396 Sep 03 01:37:11.089896 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 316/638] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:37:10 2022] POST /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/action => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:37:11.118507 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c02cdbf8-a0ea-4975-86ae-f0ae37027d6b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1318 microversion: 2.1 time: 0.452041 Sep 03 01:37:11.120206 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6b731901-837c-433c-9977-7f0507e5852b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:11.121642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6b731901-837c-433c-9977-7f0507e5852b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:11.123461 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 323/639] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:10 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1318 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:11.146099 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6b731901-837c-433c-9977-7f0507e5852b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:11.146632 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6b731901-837c-433c-9977-7f0507e5852b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:11.147064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6b731901-837c-433c-9977-7f0507e5852b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:11.149922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6b731901-837c-433c-9977-7f0507e5852b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:11.151934 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2a1120d0-d5d0-4941-8ad6-73d78badb12c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:11.152711 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6b731901-837c-433c-9977-7f0507e5852b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:11.152887 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2a1120d0-d5d0-4941-8ad6-73d78badb12c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:11.153424 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6b731901-837c-433c-9977-7f0507e5852b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:11.178398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2a1120d0-d5d0-4941-8ad6-73d78badb12c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:11.180335 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2a1120d0-d5d0-4941-8ad6-73d78badb12c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:11.182104 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2a1120d0-d5d0-4941-8ad6-73d78badb12c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:11.184764 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2a1120d0-d5d0-4941-8ad6-73d78badb12c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:11.185503 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2a1120d0-d5d0-4941-8ad6-73d78badb12c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:11.187606 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2a1120d0-d5d0-4941-8ad6-73d78badb12c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:11.654363 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2a1120d0-d5d0-4941-8ad6-73d78badb12c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:11.667217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2a1120d0-d5d0-4941-8ad6-73d78badb12c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1723 microversion: 2.1 time: 0.526788 Sep 03 01:37:11.678456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 324/640] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:11 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1723 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:11.683667 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9230e284-7a8b-4e9f-967b-4103409c8a0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:11.684629 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9230e284-7a8b-4e9f-967b-4103409c8a0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:11.691891 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9230e284-7a8b-4e9f-967b-4103409c8a0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:11.694091 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9230e284-7a8b-4e9f-967b-4103409c8a0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:11.694091 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9230e284-7a8b-4e9f-967b-4103409c8a0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:11.694649 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9230e284-7a8b-4e9f-967b-4103409c8a0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:11.695369 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9230e284-7a8b-4e9f-967b-4103409c8a0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:11.695870 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9230e284-7a8b-4e9f-967b-4103409c8a0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:11.991567 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6b731901-837c-433c-9977-7f0507e5852b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:12.005395 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6b731901-837c-433c-9977-7f0507e5852b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:12.010565 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6b731901-837c-433c-9977-7f0507e5852b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:12.013403 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6b731901-837c-433c-9977-7f0507e5852b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.921701 Sep 03 01:37:12.014666 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 317/641] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:11 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:37:12.145345 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5da767ff-4a4e-4789-8c87-8f7ddbd90c66 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:12.146106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5da767ff-4a4e-4789-8c87-8f7ddbd90c66 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:12.152294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5da767ff-4a4e-4789-8c87-8f7ddbd90c66 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:12.152782 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5da767ff-4a4e-4789-8c87-8f7ddbd90c66 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:12.153219 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5da767ff-4a4e-4789-8c87-8f7ddbd90c66 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:12.154732 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5da767ff-4a4e-4789-8c87-8f7ddbd90c66 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:12.157233 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5da767ff-4a4e-4789-8c87-8f7ddbd90c66 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:12.159071 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5da767ff-4a4e-4789-8c87-8f7ddbd90c66 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:12.185095 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9230e284-7a8b-4e9f-967b-4103409c8a0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:12.200751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9230e284-7a8b-4e9f-967b-4103409c8a0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1679 microversion: 2.1 time: 0.521060 Sep 03 01:37:12.214581 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 325/642] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:11 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1679 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:12.329351 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5da767ff-4a4e-4789-8c87-8f7ddbd90c66 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:12.342483 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5da767ff-4a4e-4789-8c87-8f7ddbd90c66 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1318 microversion: 2.1 time: 0.201101 Sep 03 01:37:12.343138 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 318/643] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:12 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:12.692263 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c8c985f5-7554-4cb8-89f7-c1f24c7dfb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:12.692889 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c8c985f5-7554-4cb8-89f7-c1f24c7dfb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:12.699035 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8c985f5-7554-4cb8-89f7-c1f24c7dfb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:12.699740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8c985f5-7554-4cb8-89f7-c1f24c7dfb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:12.700216 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8c985f5-7554-4cb8-89f7-c1f24c7dfb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:12.701076 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8c985f5-7554-4cb8-89f7-c1f24c7dfb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:12.701710 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8c985f5-7554-4cb8-89f7-c1f24c7dfb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:12.702287 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8c985f5-7554-4cb8-89f7-c1f24c7dfb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:12.977436 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c8c985f5-7554-4cb8-89f7-c1f24c7dfb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:12.985726 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c8c985f5-7554-4cb8-89f7-c1f24c7dfb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1723 microversion: 2.1 time: 0.297951 Sep 03 01:37:12.989649 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 326/644] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:12 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1723 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:13.020471 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-43fefc66-7efa-4956-b533-7d195d9b9fc9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:13.020972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-43fefc66-7efa-4956-b533-7d195d9b9fc9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:13.027375 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-43fefc66-7efa-4956-b533-7d195d9b9fc9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:13.027860 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-43fefc66-7efa-4956-b533-7d195d9b9fc9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:13.028490 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-43fefc66-7efa-4956-b533-7d195d9b9fc9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:13.029195 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-43fefc66-7efa-4956-b533-7d195d9b9fc9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:13.029826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-43fefc66-7efa-4956-b533-7d195d9b9fc9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:13.030239 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-43fefc66-7efa-4956-b533-7d195d9b9fc9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:13.046963 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-65285469-c261-4e35-9424-b756cf7b7ae8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:13.046963 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-65285469-c261-4e35-9424-b756cf7b7ae8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:13.053264 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-65285469-c261-4e35-9424-b756cf7b7ae8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:13.054025 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-65285469-c261-4e35-9424-b756cf7b7ae8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:13.054655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-65285469-c261-4e35-9424-b756cf7b7ae8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:13.056016 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-65285469-c261-4e35-9424-b756cf7b7ae8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:13.057830 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-65285469-c261-4e35-9424-b756cf7b7ae8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:13.058562 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-65285469-c261-4e35-9424-b756cf7b7ae8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:13.172141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-43fefc66-7efa-4956-b533-7d195d9b9fc9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lazy-loading 'services' on Instance uuid 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:37:13.356041 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-65285469-c261-4e35-9424-b756cf7b7ae8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:13.379531 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-65285469-c261-4e35-9424-b756cf7b7ae8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:13.382207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-65285469-c261-4e35-9424-b756cf7b7ae8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:13.383725 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-65285469-c261-4e35-9424-b756cf7b7ae8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.344843 Sep 03 01:37:13.384620 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 327/645] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:13 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:37:13.389692 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-23732e88-ba99-47f0-a79f-c88890a6ad80 req-657024e1-0983-4832-9d31-bd2e1fd37d46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329ea656-c337-4f07-bd3d-9f67c4d6418e", "name": "network-vif-plugged", "status": "completed", "tag": "8e331545-f680-453c-942e-5cd9fc274b5f"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:13.407927 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-23732e88-ba99-47f0-a79f-c88890a6ad80 req-657024e1-0983-4832-9d31-bd2e1fd37d46 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:13.408969 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-23732e88-ba99-47f0-a79f-c88890a6ad80 req-657024e1-0983-4832-9d31-bd2e1fd37d46 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:13.410487 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-23732e88-ba99-47f0-a79f-c88890a6ad80 req-657024e1-0983-4832-9d31-bd2e1fd37d46 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:13.426807 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-23732e88-ba99-47f0-a79f-c88890a6ad80 req-657024e1-0983-4832-9d31-bd2e1fd37d46 service nova] Creating event network-vif-plugged:8e331545-f680-453c-942e-5cd9fc274b5f for instance 329ea656-c337-4f07-bd3d-9f67c4d6418e on hv-cinder-83800 Sep 03 01:37:13.434093 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-23732e88-ba99-47f0-a79f-c88890a6ad80 req-657024e1-0983-4832-9d31-bd2e1fd37d46 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048087 Sep 03 01:37:13.436084 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 328/646] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:13.443972 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-26f6dcc1-9987-43eb-88bf-fd8c7edafe12 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:13.444873 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-26f6dcc1-9987-43eb-88bf-fd8c7edafe12 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:13.452349 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-26f6dcc1-9987-43eb-88bf-fd8c7edafe12 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:13.452807 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-26f6dcc1-9987-43eb-88bf-fd8c7edafe12 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:13.453204 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-26f6dcc1-9987-43eb-88bf-fd8c7edafe12 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:13.453898 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-26f6dcc1-9987-43eb-88bf-fd8c7edafe12 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:13.454375 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-26f6dcc1-9987-43eb-88bf-fd8c7edafe12 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:13.454861 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-26f6dcc1-9987-43eb-88bf-fd8c7edafe12 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:13.513571 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-43fefc66-7efa-4956-b533-7d195d9b9fc9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments/ac82605a-b9eb-4d6d-8095-6d66e17c59c2" status: 202 len: 0 microversion: 2.1 time: 0.497368 Sep 03 01:37:13.514271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 319/647] 10.222.0.13 () {58 vars in 1416 bytes} [Sat Sep 3 01:37:13 2022] DELETE /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments/ac82605a-b9eb-4d6d-8095-6d66e17c59c2 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:37:13.520617 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5c5afa4f-1a02-4c78-9abb-d74c1c3e32f5 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:13.523343 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5c5afa4f-1a02-4c78-9abb-d74c1c3e32f5 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:13.532426 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5c5afa4f-1a02-4c78-9abb-d74c1c3e32f5 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:13.533549 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5c5afa4f-1a02-4c78-9abb-d74c1c3e32f5 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:13.534271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5c5afa4f-1a02-4c78-9abb-d74c1c3e32f5 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:13.535347 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5c5afa4f-1a02-4c78-9abb-d74c1c3e32f5 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:13.535996 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5c5afa4f-1a02-4c78-9abb-d74c1c3e32f5 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:13.536875 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5c5afa4f-1a02-4c78-9abb-d74c1c3e32f5 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:13.706320 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-26f6dcc1-9987-43eb-88bf-fd8c7edafe12 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:13.715845 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-26f6dcc1-9987-43eb-88bf-fd8c7edafe12 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1679 microversion: 2.1 time: 0.277886 Sep 03 01:37:13.727776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 329/648] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:13 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1679 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:13.734226 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f145b695-d095-4516-b6c9-064552caf658 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:13.737850 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f145b695-d095-4516-b6c9-064552caf658 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:13.745462 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f145b695-d095-4516-b6c9-064552caf658 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:13.747641 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f145b695-d095-4516-b6c9-064552caf658 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:13.747641 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f145b695-d095-4516-b6c9-064552caf658 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:13.747641 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f145b695-d095-4516-b6c9-064552caf658 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:13.747952 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f145b695-d095-4516-b6c9-064552caf658 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:13.748381 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f145b695-d095-4516-b6c9-064552caf658 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:13.782689 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f145b695-d095-4516-b6c9-064552caf658 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052892 Sep 03 01:37:13.783807 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 330/649] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:37:13 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:13.797032 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5c5afa4f-1a02-4c78-9abb-d74c1c3e32f5 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:13.811381 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5c5afa4f-1a02-4c78-9abb-d74c1c3e32f5 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1318 microversion: 2.1 time: 0.295636 Sep 03 01:37:13.812131 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 320/650] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:13 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1318 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:14.013978 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-735a776a-66ad-4607-8fbe-bc14e1b2577f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:14.014151 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-735a776a-66ad-4607-8fbe-bc14e1b2577f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:14.021785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-735a776a-66ad-4607-8fbe-bc14e1b2577f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:14.025096 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-735a776a-66ad-4607-8fbe-bc14e1b2577f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:14.025096 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-735a776a-66ad-4607-8fbe-bc14e1b2577f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:14.025096 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-735a776a-66ad-4607-8fbe-bc14e1b2577f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:14.028838 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-735a776a-66ad-4607-8fbe-bc14e1b2577f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:14.029342 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-735a776a-66ad-4607-8fbe-bc14e1b2577f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:14.057863 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d8e04a4c-6713-4d8a-abec-e7ae32c42929 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1898220344"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:14.058520 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d8e04a4c-6713-4d8a-abec-e7ae32c42929 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:14.067462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d8e04a4c-6713-4d8a-abec-e7ae32c42929 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:14.068160 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d8e04a4c-6713-4d8a-abec-e7ae32c42929 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:14.068598 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d8e04a4c-6713-4d8a-abec-e7ae32c42929 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:14.070641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d8e04a4c-6713-4d8a-abec-e7ae32c42929 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:14.071648 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d8e04a4c-6713-4d8a-abec-e7ae32c42929 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:14.072741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d8e04a4c-6713-4d8a-abec-e7ae32c42929 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:14.213512 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-735a776a-66ad-4607-8fbe-bc14e1b2577f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:14.230689 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-735a776a-66ad-4607-8fbe-bc14e1b2577f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1723 microversion: 2.1 time: 0.216467 Sep 03 01:37:14.238256 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.network.security_group_api [None req-d8e04a4c-6713-4d8a-abec-e7ae32c42929 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Adding security group 44914223-3606-4f07-acb6-c511676b38c1 to port f1b93106-790d-4f9d-9fae-cd59eef8bc20 Sep 03 01:37:14.246735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 331/651] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:14 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:14.414500 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-22b368cd-a566-4281-a2c8-2475e172f2dd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:14.415130 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-22b368cd-a566-4281-a2c8-2475e172f2dd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:14.426492 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22b368cd-a566-4281-a2c8-2475e172f2dd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:14.427397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22b368cd-a566-4281-a2c8-2475e172f2dd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:14.428041 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22b368cd-a566-4281-a2c8-2475e172f2dd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:14.428895 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22b368cd-a566-4281-a2c8-2475e172f2dd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:14.429486 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22b368cd-a566-4281-a2c8-2475e172f2dd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:14.430105 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22b368cd-a566-4281-a2c8-2475e172f2dd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:14.684894 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-22b368cd-a566-4281-a2c8-2475e172f2dd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:14.698910 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-22b368cd-a566-4281-a2c8-2475e172f2dd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:14.700712 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-22b368cd-a566-4281-a2c8-2475e172f2dd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:14.702323 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-22b368cd-a566-4281-a2c8-2475e172f2dd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.292581 Sep 03 01:37:14.703436 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 332/652] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:14 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:37:14.743013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ef850023-823d-44dc-aac7-8d27fc674a4a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:14.744397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ef850023-823d-44dc-aac7-8d27fc674a4a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:14.758101 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef850023-823d-44dc-aac7-8d27fc674a4a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:14.759126 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef850023-823d-44dc-aac7-8d27fc674a4a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:14.759745 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef850023-823d-44dc-aac7-8d27fc674a4a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:14.761155 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef850023-823d-44dc-aac7-8d27fc674a4a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:14.762156 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef850023-823d-44dc-aac7-8d27fc674a4a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:14.762633 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef850023-823d-44dc-aac7-8d27fc674a4a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:14.918259 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ef850023-823d-44dc-aac7-8d27fc674a4a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:14.926489 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ef850023-823d-44dc-aac7-8d27fc674a4a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1679 microversion: 2.1 time: 0.190214 Sep 03 01:37:14.927080 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 333/653] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:14 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:14.938616 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-94383143-5c38-4615-88a1-3663c0e26baa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:14.941779 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-94383143-5c38-4615-88a1-3663c0e26baa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:14.948997 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-94383143-5c38-4615-88a1-3663c0e26baa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:14.949519 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-94383143-5c38-4615-88a1-3663c0e26baa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:14.949932 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-94383143-5c38-4615-88a1-3663c0e26baa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:14.950679 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-94383143-5c38-4615-88a1-3663c0e26baa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:14.951136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-94383143-5c38-4615-88a1-3663c0e26baa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:14.951576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-94383143-5c38-4615-88a1-3663c0e26baa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:14.987758 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-94383143-5c38-4615-88a1-3663c0e26baa tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053237 Sep 03 01:37:14.988439 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 334/654] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:37:14 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:14.994276 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3253b59f-13c8-4671-8c9d-226446caa0f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:14.995093 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-3253b59f-13c8-4671-8c9d-226446caa0f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:15.002838 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3253b59f-13c8-4671-8c9d-226446caa0f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:15.004258 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3253b59f-13c8-4671-8c9d-226446caa0f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:15.008846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3253b59f-13c8-4671-8c9d-226446caa0f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:15.008846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3253b59f-13c8-4671-8c9d-226446caa0f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:15.008846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3253b59f-13c8-4671-8c9d-226446caa0f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:15.008846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3253b59f-13c8-4671-8c9d-226446caa0f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:15.026532 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d8e04a4c-6713-4d8a-abec-e7ae32c42929 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "POST /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/action" status: 202 len: 0 microversion: 2.1 time: 0.979208 Sep 03 01:37:15.027146 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 321/655] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:37:14 2022] POST /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/action => generated 0 bytes in 981 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:37:15.036485 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-284703fb-4ae2-4e12-bec0-9cd55a577673 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:15.037521 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-284703fb-4ae2-4e12-bec0-9cd55a577673 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:15.038219 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:15.044425 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-284703fb-4ae2-4e12-bec0-9cd55a577673 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:15.045165 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-284703fb-4ae2-4e12-bec0-9cd55a577673 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:15.045789 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-284703fb-4ae2-4e12-bec0-9cd55a577673 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:15.046845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-284703fb-4ae2-4e12-bec0-9cd55a577673 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:15.047459 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-284703fb-4ae2-4e12-bec0-9cd55a577673 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:15.048034 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-284703fb-4ae2-4e12-bec0-9cd55a577673 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:15.179466 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3253b59f-13c8-4671-8c9d-226446caa0f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:15.188456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3253b59f-13c8-4671-8c9d-226446caa0f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1318 microversion: 2.1 time: 0.198735 Sep 03 01:37:15.190037 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 335/656] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:14 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:15.195568 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-1a738c3c-cde5-4411-927a-ec2d2b29dae9 req-9f94d893-85c8-4785-967c-8ddac316b338 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5df2d41-c884-4178-9a70-150c16cf1c5f", "tag": "f1b93106-790d-4f9d-9fae-cd59eef8bc20"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:15.207316 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-1a738c3c-cde5-4411-927a-ec2d2b29dae9 req-9f94d893-85c8-4785-967c-8ddac316b338 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:15.207801 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-1a738c3c-cde5-4411-927a-ec2d2b29dae9 req-9f94d893-85c8-4785-967c-8ddac316b338 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:15.209072 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-1a738c3c-cde5-4411-927a-ec2d2b29dae9 req-9f94d893-85c8-4785-967c-8ddac316b338 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:15.223707 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-1a738c3c-cde5-4411-927a-ec2d2b29dae9 req-9f94d893-85c8-4785-967c-8ddac316b338 service nova] Creating event network-changed:f1b93106-790d-4f9d-9fae-cd59eef8bc20 for instance e5df2d41-c884-4178-9a70-150c16cf1c5f on hv-cinder-83800 Sep 03 01:37:15.228917 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-1a738c3c-cde5-4411-927a-ec2d2b29dae9 req-9f94d893-85c8-4785-967c-8ddac316b338 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036910 Sep 03 01:37:15.229522 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 336/657] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:37:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:15.264181 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e820c3d5-11d5-4352-809d-37a7f7157516 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:15.266271 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e820c3d5-11d5-4352-809d-37a7f7157516 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:15.274140 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e820c3d5-11d5-4352-809d-37a7f7157516 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:15.274680 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e820c3d5-11d5-4352-809d-37a7f7157516 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:15.276063 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e820c3d5-11d5-4352-809d-37a7f7157516 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:15.276063 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e820c3d5-11d5-4352-809d-37a7f7157516 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:15.276406 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e820c3d5-11d5-4352-809d-37a7f7157516 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:15.277025 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e820c3d5-11d5-4352-809d-37a7f7157516 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:15.349779 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-284703fb-4ae2-4e12-bec0-9cd55a577673 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:15.366627 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-284703fb-4ae2-4e12-bec0-9cd55a577673 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1761 microversion: 2.1 time: 0.334440 Sep 03 01:37:15.367786 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 322/658] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:15 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1761 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:15.439988 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e820c3d5-11d5-4352-809d-37a7f7157516 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:15.450145 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e820c3d5-11d5-4352-809d-37a7f7157516 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1723 microversion: 2.1 time: 0.190712 Sep 03 01:37:15.451532 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 337/659] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:15 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:15.729503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a6cfcffe-3eae-48bf-ab99-73ae0cd12f5d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:15.730715 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a6cfcffe-3eae-48bf-ab99-73ae0cd12f5d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:15.737546 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a6cfcffe-3eae-48bf-ab99-73ae0cd12f5d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:15.738048 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a6cfcffe-3eae-48bf-ab99-73ae0cd12f5d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:15.738540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a6cfcffe-3eae-48bf-ab99-73ae0cd12f5d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:15.739245 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a6cfcffe-3eae-48bf-ab99-73ae0cd12f5d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:15.739703 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a6cfcffe-3eae-48bf-ab99-73ae0cd12f5d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:15.740133 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a6cfcffe-3eae-48bf-ab99-73ae0cd12f5d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:15.952526 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-118f909b-0f33-4f98-be8f-01ae632e9e68 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:15.953988 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-118f909b-0f33-4f98-be8f-01ae632e9e68 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:15.960703 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-118f909b-0f33-4f98-be8f-01ae632e9e68 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:15.961322 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-118f909b-0f33-4f98-be8f-01ae632e9e68 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:15.961855 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-118f909b-0f33-4f98-be8f-01ae632e9e68 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:15.962968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-118f909b-0f33-4f98-be8f-01ae632e9e68 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:15.963673 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-118f909b-0f33-4f98-be8f-01ae632e9e68 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:15.964189 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-118f909b-0f33-4f98-be8f-01ae632e9e68 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:15.989990 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a6cfcffe-3eae-48bf-ab99-73ae0cd12f5d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:16.002009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a6cfcffe-3eae-48bf-ab99-73ae0cd12f5d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:16.006164 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a6cfcffe-3eae-48bf-ab99-73ae0cd12f5d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:16.007464 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a6cfcffe-3eae-48bf-ab99-73ae0cd12f5d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.282311 Sep 03 01:37:16.034548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 323/660] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:15 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:37:16.045066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2a3f1251-a749-4050-a8d8-f846e82055dc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:16.052952 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2a3f1251-a749-4050-a8d8-f846e82055dc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:16.065079 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2a3f1251-a749-4050-a8d8-f846e82055dc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:16.065764 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2a3f1251-a749-4050-a8d8-f846e82055dc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:16.066611 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2a3f1251-a749-4050-a8d8-f846e82055dc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:16.068237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2a3f1251-a749-4050-a8d8-f846e82055dc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:16.068917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2a3f1251-a749-4050-a8d8-f846e82055dc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:16.069581 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2a3f1251-a749-4050-a8d8-f846e82055dc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:16.109172 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:16.115915 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2a3f1251-a749-4050-a8d8-f846e82055dc tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079834 Sep 03 01:37:16.116817 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 324/661] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:37:16 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:16.217089 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-faf1c7e0-98d4-4bb7-aee8-80ef424cfcd6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:16.218111 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-faf1c7e0-98d4-4bb7-aee8-80ef424cfcd6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:16.228211 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-faf1c7e0-98d4-4bb7-aee8-80ef424cfcd6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:16.234460 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-faf1c7e0-98d4-4bb7-aee8-80ef424cfcd6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:16.235361 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-faf1c7e0-98d4-4bb7-aee8-80ef424cfcd6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:16.238287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-faf1c7e0-98d4-4bb7-aee8-80ef424cfcd6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:16.238862 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-faf1c7e0-98d4-4bb7-aee8-80ef424cfcd6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:16.239311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-faf1c7e0-98d4-4bb7-aee8-80ef424cfcd6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:16.247272 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-118f909b-0f33-4f98-be8f-01ae632e9e68 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:16.264612 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-118f909b-0f33-4f98-be8f-01ae632e9e68 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1679 microversion: 2.1 time: 0.315842 Sep 03 01:37:16.266233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 338/662] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:15 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1679 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:16.478011 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-86d1512d-88a3-4d6a-ade2-13365364a728 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:16.478664 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-86d1512d-88a3-4d6a-ade2-13365364a728 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:16.488484 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-86d1512d-88a3-4d6a-ade2-13365364a728 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:16.488484 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-86d1512d-88a3-4d6a-ade2-13365364a728 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:16.488484 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-86d1512d-88a3-4d6a-ade2-13365364a728 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:16.488484 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-86d1512d-88a3-4d6a-ade2-13365364a728 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:16.488866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-86d1512d-88a3-4d6a-ade2-13365364a728 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:16.489641 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-86d1512d-88a3-4d6a-ade2-13365364a728 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:16.507399 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-faf1c7e0-98d4-4bb7-aee8-80ef424cfcd6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:16.519791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-faf1c7e0-98d4-4bb7-aee8-80ef424cfcd6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1318 microversion: 2.1 time: 0.307150 Sep 03 01:37:16.521233 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 325/663] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:16 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:16.665695 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-86d1512d-88a3-4d6a-ade2-13365364a728 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:16.675027 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-86d1512d-88a3-4d6a-ade2-13365364a728 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1729 microversion: 2.1 time: 0.202472 Sep 03 01:37:16.676236 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 339/664] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:16 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1729 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:16.707526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ae93754f-ec1b-49d6-b670-55cac7d89e98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:16.708287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ae93754f-ec1b-49d6-b670-55cac7d89e98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:16.724131 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae93754f-ec1b-49d6-b670-55cac7d89e98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:16.726930 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae93754f-ec1b-49d6-b670-55cac7d89e98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:16.730059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae93754f-ec1b-49d6-b670-55cac7d89e98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:16.731834 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae93754f-ec1b-49d6-b670-55cac7d89e98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:16.732597 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae93754f-ec1b-49d6-b670-55cac7d89e98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:16.735050 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae93754f-ec1b-49d6-b670-55cac7d89e98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:17.039809 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ed49184d-7158-4b12-b1bb-be725e0fb39b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:17.041023 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ed49184d-7158-4b12-b1bb-be725e0fb39b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:17.047314 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed49184d-7158-4b12-b1bb-be725e0fb39b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:17.048088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed49184d-7158-4b12-b1bb-be725e0fb39b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:17.049006 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed49184d-7158-4b12-b1bb-be725e0fb39b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:17.049899 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed49184d-7158-4b12-b1bb-be725e0fb39b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:17.050582 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed49184d-7158-4b12-b1bb-be725e0fb39b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:17.051342 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed49184d-7158-4b12-b1bb-be725e0fb39b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:17.228694 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ae93754f-ec1b-49d6-b670-55cac7d89e98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.533227 Sep 03 01:37:17.241449 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 326/665] 10.222.0.13 () {58 vars in 1275 bytes} [Sat Sep 3 01:37:16 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-interface => generated 284 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:17.246942 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4de88159-f65a-4972-b0d6-82cd65d4fb8b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:17.254266 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4de88159-f65a-4972-b0d6-82cd65d4fb8b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:17.270132 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4de88159-f65a-4972-b0d6-82cd65d4fb8b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:17.270689 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4de88159-f65a-4972-b0d6-82cd65d4fb8b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:17.271134 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4de88159-f65a-4972-b0d6-82cd65d4fb8b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:17.271844 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4de88159-f65a-4972-b0d6-82cd65d4fb8b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:17.272315 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4de88159-f65a-4972-b0d6-82cd65d4fb8b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:17.272725 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4de88159-f65a-4972-b0d6-82cd65d4fb8b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:17.342163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4de88159-f65a-4972-b0d6-82cd65d4fb8b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099332 Sep 03 01:37:17.343378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 327/666] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:37:17 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:17.350241 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-870e543e-b9c4-4d19-850e-ad0b42a5dbc5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:17.350241 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-870e543e-b9c4-4d19-850e-ad0b42a5dbc5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:17.370235 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-870e543e-b9c4-4d19-850e-ad0b42a5dbc5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:17.373224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-870e543e-b9c4-4d19-850e-ad0b42a5dbc5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:17.373224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-870e543e-b9c4-4d19-850e-ad0b42a5dbc5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:17.373224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-870e543e-b9c4-4d19-850e-ad0b42a5dbc5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:17.373224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-870e543e-b9c4-4d19-850e-ad0b42a5dbc5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:17.373611 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-870e543e-b9c4-4d19-850e-ad0b42a5dbc5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:17.616442 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ed49184d-7158-4b12-b1bb-be725e0fb39b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:17.626819 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ed49184d-7158-4b12-b1bb-be725e0fb39b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:17.628613 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ed49184d-7158-4b12-b1bb-be725e0fb39b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:17.630082 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ed49184d-7158-4b12-b1bb-be725e0fb39b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.594265 Sep 03 01:37:17.631068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 340/667] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:17 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:37:17.635967 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b1eb556e-6805-4ae6-a86e-20531efb95c7 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:17.636812 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b1eb556e-6805-4ae6-a86e-20531efb95c7 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:17.644329 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b1eb556e-6805-4ae6-a86e-20531efb95c7 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:17.645042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b1eb556e-6805-4ae6-a86e-20531efb95c7 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:17.645767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b1eb556e-6805-4ae6-a86e-20531efb95c7 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:17.646855 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b1eb556e-6805-4ae6-a86e-20531efb95c7 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:17.647595 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b1eb556e-6805-4ae6-a86e-20531efb95c7 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:17.648280 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b1eb556e-6805-4ae6-a86e-20531efb95c7 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:17.707278 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-870e543e-b9c4-4d19-850e-ad0b42a5dbc5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:17.715606 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-870e543e-b9c4-4d19-850e-ad0b42a5dbc5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1679 microversion: 2.1 time: 0.371042 Sep 03 01:37:17.716723 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 328/668] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:17 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1679 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:17.722480 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-18f89ad6-f09f-4aca-a8bd-2559f1bf1d62 req-3cafe27b-5699-41b5-9b90-e0f63b89c23c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ed6fe4-9955-4b04-b20d-b2f60e944310", "name": "network-vif-plugged", "status": "completed", "tag": "91fcf0db-d435-4413-9523-d181eb8e1ae2"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:17.735312 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-18f89ad6-f09f-4aca-a8bd-2559f1bf1d62 req-3cafe27b-5699-41b5-9b90-e0f63b89c23c service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:17.735312 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-18f89ad6-f09f-4aca-a8bd-2559f1bf1d62 req-3cafe27b-5699-41b5-9b90-e0f63b89c23c service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:17.735312 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-18f89ad6-f09f-4aca-a8bd-2559f1bf1d62 req-3cafe27b-5699-41b5-9b90-e0f63b89c23c service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:17.758162 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-18f89ad6-f09f-4aca-a8bd-2559f1bf1d62 req-3cafe27b-5699-41b5-9b90-e0f63b89c23c service nova] Creating event network-vif-plugged:91fcf0db-d435-4413-9523-d181eb8e1ae2 for instance 51ed6fe4-9955-4b04-b20d-b2f60e944310 on hv-cinder-83800 Sep 03 01:37:17.764066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-18f89ad6-f09f-4aca-a8bd-2559f1bf1d62 req-3cafe27b-5699-41b5-9b90-e0f63b89c23c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045752 Sep 03 01:37:17.765393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 329/669] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:37:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:17.814542 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b1eb556e-6805-4ae6-a86e-20531efb95c7 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:17.833309 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b1eb556e-6805-4ae6-a86e-20531efb95c7 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1318 microversion: 2.1 time: 0.200871 Sep 03 01:37:17.833907 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 341/670] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:17 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:18.357208 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-3e2ebb44-7bf0-4496-9de3-245e893d7dd6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:18.360623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-3e2ebb44-7bf0-4496-9de3-245e893d7dd6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:18.379897 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e2ebb44-7bf0-4496-9de3-245e893d7dd6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:18.384850 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e2ebb44-7bf0-4496-9de3-245e893d7dd6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:18.385345 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e2ebb44-7bf0-4496-9de3-245e893d7dd6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:18.386105 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e2ebb44-7bf0-4496-9de3-245e893d7dd6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:18.386603 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e2ebb44-7bf0-4496-9de3-245e893d7dd6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:18.389102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e2ebb44-7bf0-4496-9de3-245e893d7dd6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:18.443688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-3e2ebb44-7bf0-4496-9de3-245e893d7dd6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091449 Sep 03 01:37:18.450814 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 330/671] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:37:18 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 01:37:18.524317 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2068e1b0-c368-4ea9-88bf-ab7e93caf1f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:18.524831 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2068e1b0-c368-4ea9-88bf-ab7e93caf1f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:18.534737 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2068e1b0-c368-4ea9-88bf-ab7e93caf1f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:18.535232 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2068e1b0-c368-4ea9-88bf-ab7e93caf1f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:18.535839 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2068e1b0-c368-4ea9-88bf-ab7e93caf1f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:18.537225 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2068e1b0-c368-4ea9-88bf-ab7e93caf1f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:18.538140 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2068e1b0-c368-4ea9-88bf-ab7e93caf1f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:18.538746 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2068e1b0-c368-4ea9-88bf-ab7e93caf1f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:18.577167 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2068e1b0-c368-4ea9-88bf-ab7e93caf1f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Going to try to terminate instance {{(pid=127552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:37:18.657213 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ee677c3e-9b7c-45bd-9709-63854d0d2912 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:18.657894 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ee677c3e-9b7c-45bd-9709-63854d0d2912 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:18.671538 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ee677c3e-9b7c-45bd-9709-63854d0d2912 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:18.679170 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ee677c3e-9b7c-45bd-9709-63854d0d2912 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:18.680235 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ee677c3e-9b7c-45bd-9709-63854d0d2912 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:18.685292 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ee677c3e-9b7c-45bd-9709-63854d0d2912 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:18.685963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ee677c3e-9b7c-45bd-9709-63854d0d2912 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:18.690816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ee677c3e-9b7c-45bd-9709-63854d0d2912 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:18.931881 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ee677c3e-9b7c-45bd-9709-63854d0d2912 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:18.944118 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ee677c3e-9b7c-45bd-9709-63854d0d2912 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:18.947942 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ee677c3e-9b7c-45bd-9709-63854d0d2912 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:18.955261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ee677c3e-9b7c-45bd-9709-63854d0d2912 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.301339 Sep 03 01:37:18.955261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 331/672] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:18 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:37:18.967089 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ac01cf9d-3135-4bf5-b097-337dd4d64691 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:18.967847 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ac01cf9d-3135-4bf5-b097-337dd4d64691 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:18.980641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ac01cf9d-3135-4bf5-b097-337dd4d64691 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:18.981261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ac01cf9d-3135-4bf5-b097-337dd4d64691 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:18.985257 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ac01cf9d-3135-4bf5-b097-337dd4d64691 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:18.985257 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ac01cf9d-3135-4bf5-b097-337dd4d64691 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:18.985257 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ac01cf9d-3135-4bf5-b097-337dd4d64691 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:18.985257 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ac01cf9d-3135-4bf5-b097-337dd4d64691 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:19.068338 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2068e1b0-c368-4ea9-88bf-ab7e93caf1f0 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 204 len: 0 microversion: 2.1 time: 0.548840 Sep 03 01:37:19.068944 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 342/673] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:37:18 2022] DELETE /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:37:19.077360 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-02e6d3a9-65f7-4b84-9352-a9ac3f51db5b req-4bc825e3-7871-4908-ba6c-997da0639ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34abe46a-5361-4e96-a952-5909fad8c4f4", "tag": "885d8df4-2f3f-463e-aa94-cb8b3ae9cb29"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:19.103611 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-02e6d3a9-65f7-4b84-9352-a9ac3f51db5b req-4bc825e3-7871-4908-ba6c-997da0639ea6 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:19.106003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-02e6d3a9-65f7-4b84-9352-a9ac3f51db5b req-4bc825e3-7871-4908-ba6c-997da0639ea6 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:19.106838 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-02e6d3a9-65f7-4b84-9352-a9ac3f51db5b req-4bc825e3-7871-4908-ba6c-997da0639ea6 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:19.130502 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-02e6d3a9-65f7-4b84-9352-a9ac3f51db5b req-4bc825e3-7871-4908-ba6c-997da0639ea6 service nova] Creating event network-changed:885d8df4-2f3f-463e-aa94-cb8b3ae9cb29 for instance 34abe46a-5361-4e96-a952-5909fad8c4f4 on hv-cinder-83800 Sep 03 01:37:19.146523 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-02e6d3a9-65f7-4b84-9352-a9ac3f51db5b req-4bc825e3-7871-4908-ba6c-997da0639ea6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074692 Sep 03 01:37:19.149072 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 343/674] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:19.159770 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f42c7037-c9f5-4c08-959e-99717f3101ef tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:19.163232 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f42c7037-c9f5-4c08-959e-99717f3101ef tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:19.196612 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f42c7037-c9f5-4c08-959e-99717f3101ef tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:19.198610 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f42c7037-c9f5-4c08-959e-99717f3101ef tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:19.198610 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f42c7037-c9f5-4c08-959e-99717f3101ef tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:19.198610 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f42c7037-c9f5-4c08-959e-99717f3101ef tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:19.200104 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f42c7037-c9f5-4c08-959e-99717f3101ef tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:19.203139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f42c7037-c9f5-4c08-959e-99717f3101ef tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:19.255817 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ac01cf9d-3135-4bf5-b097-337dd4d64691 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:19.266447 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ac01cf9d-3135-4bf5-b097-337dd4d64691 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1656 microversion: 2.1 time: 0.309610 Sep 03 01:37:19.279608 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 332/675] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:18 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1656 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:19.291137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9e85edd2-c265-4527-975e-94cd5007986a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:19.291995 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9e85edd2-c265-4527-975e-94cd5007986a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:19.305033 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e85edd2-c265-4527-975e-94cd5007986a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:19.305852 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e85edd2-c265-4527-975e-94cd5007986a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:19.306573 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e85edd2-c265-4527-975e-94cd5007986a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:19.307526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e85edd2-c265-4527-975e-94cd5007986a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:19.308283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e85edd2-c265-4527-975e-94cd5007986a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:19.309650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9e85edd2-c265-4527-975e-94cd5007986a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:19.546849 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9e85edd2-c265-4527-975e-94cd5007986a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:19.564892 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9e85edd2-c265-4527-975e-94cd5007986a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1681 microversion: 2.1 time: 0.283343 Sep 03 01:37:19.567022 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 333/676] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:19 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1681 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:19.578218 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2c89f536-ec12-4972-84ae-aac8041d229d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:19.587516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c89f536-ec12-4972-84ae-aac8041d229d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:19.588225 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c89f536-ec12-4972-84ae-aac8041d229d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:19.589077 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c89f536-ec12-4972-84ae-aac8041d229d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:19.619479 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2c89f536-ec12-4972-84ae-aac8041d229d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Going to try to start instance {{(pid=127553) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 03 01:37:19.687339 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f42c7037-c9f5-4c08-959e-99717f3101ef tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:19.698450 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f42c7037-c9f5-4c08-959e-99717f3101ef tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1318 microversion: 2.1 time: 0.546555 Sep 03 01:37:19.720707 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 344/677] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:19 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1318 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:19.859207 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2c89f536-ec12-4972-84ae-aac8041d229d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "POST /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/action" status: 202 len: 0 microversion: 2.1 time: 0.289914 Sep 03 01:37:19.860494 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 334/678] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:37:19 2022] POST /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:37:19.869208 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-4965fbc8-59ce-4ee2-ad69-6fe7fa7fc759 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:19.869824 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-4965fbc8-59ce-4ee2-ad69-6fe7fa7fc759 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:19.876949 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4965fbc8-59ce-4ee2-ad69-6fe7fa7fc759 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:19.877443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4965fbc8-59ce-4ee2-ad69-6fe7fa7fc759 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:19.877875 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4965fbc8-59ce-4ee2-ad69-6fe7fa7fc759 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:19.878602 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4965fbc8-59ce-4ee2-ad69-6fe7fa7fc759 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:19.883736 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4965fbc8-59ce-4ee2-ad69-6fe7fa7fc759 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:19.883736 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4965fbc8-59ce-4ee2-ad69-6fe7fa7fc759 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:19.987744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5bc88839-4b77-4937-9297-b4de999bcfd1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:19.990070 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5bc88839-4b77-4937-9297-b4de999bcfd1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:19.998759 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5bc88839-4b77-4937-9297-b4de999bcfd1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:20.000514 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5bc88839-4b77-4937-9297-b4de999bcfd1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:20.001455 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5bc88839-4b77-4937-9297-b4de999bcfd1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:20.002324 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5bc88839-4b77-4937-9297-b4de999bcfd1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:20.002979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5bc88839-4b77-4937-9297-b4de999bcfd1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:20.003576 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5bc88839-4b77-4937-9297-b4de999bcfd1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:20.081075 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-4965fbc8-59ce-4ee2-ad69-6fe7fa7fc759 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:20.102681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-4965fbc8-59ce-4ee2-ad69-6fe7fa7fc759 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1665 microversion: 2.1 time: 0.235777 Sep 03 01:37:20.104149 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 345/679] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:19 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1665 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:20.226377 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5bc88839-4b77-4937-9297-b4de999bcfd1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:20.241040 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5bc88839-4b77-4937-9297-b4de999bcfd1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:20.242979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5bc88839-4b77-4937-9297-b4de999bcfd1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:20.244110 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5bc88839-4b77-4937-9297-b4de999bcfd1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1809 microversion: 2.20 time: 0.263660 Sep 03 01:37:20.244671 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 335/680] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:19 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1809 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:37:20.589351 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d221aaef-9af6-4f61-abe4-4b6ab51a9539 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:20.590380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d221aaef-9af6-4f61-abe4-4b6ab51a9539 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:20.599756 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d221aaef-9af6-4f61-abe4-4b6ab51a9539 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:20.602853 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d221aaef-9af6-4f61-abe4-4b6ab51a9539 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:20.603394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d221aaef-9af6-4f61-abe4-4b6ab51a9539 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:20.604219 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d221aaef-9af6-4f61-abe4-4b6ab51a9539 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:20.604863 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d221aaef-9af6-4f61-abe4-4b6ab51a9539 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:20.605095 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d221aaef-9af6-4f61-abe4-4b6ab51a9539 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:20.725867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cf206409-1140-45fe-94ef-cbc673e9d0a0 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:20.727064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-cf206409-1140-45fe-94ef-cbc673e9d0a0 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:20.735049 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cf206409-1140-45fe-94ef-cbc673e9d0a0 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:20.736020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cf206409-1140-45fe-94ef-cbc673e9d0a0 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:20.736713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cf206409-1140-45fe-94ef-cbc673e9d0a0 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:20.737653 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cf206409-1140-45fe-94ef-cbc673e9d0a0 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:20.738355 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cf206409-1140-45fe-94ef-cbc673e9d0a0 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:20.738998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cf206409-1140-45fe-94ef-cbc673e9d0a0 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:20.847323 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d221aaef-9af6-4f61-abe4-4b6ab51a9539 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:20.859777 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d221aaef-9af6-4f61-abe4-4b6ab51a9539 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1681 microversion: 2.1 time: 0.274544 Sep 03 01:37:20.861859 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 346/681] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:20 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1681 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:21.005720 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cf206409-1140-45fe-94ef-cbc673e9d0a0 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:21.014619 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-cf206409-1140-45fe-94ef-cbc673e9d0a0 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1318 microversion: 2.1 time: 0.292752 Sep 03 01:37:21.015311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 336/682] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:20 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1318 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:21.133420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e2b50f95-52c5-40e8-9710-a733840a9541 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Action: 'create', calling method: .version_select at 0x7f6d24b074c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-467180834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOWKOsxG4HMVvMoIlKUY7KszwejrCXuYETIEnuTVCdO30xsw4rOXeIYpYuFXhBwaADEGt8gvPDrCWXElCCbVrahAzyTEFRpryj0SbXvnimg+LJjp38vr3ijjp90EbXvLZA=="}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:21.133995 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bdf0938a-4816-4049-b68a-d9736251ac95 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:21.134649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bdf0938a-4816-4049-b68a-d9736251ac95 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:21.142767 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bdf0938a-4816-4049-b68a-d9736251ac95 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:21.143358 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bdf0938a-4816-4049-b68a-d9736251ac95 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:21.143857 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bdf0938a-4816-4049-b68a-d9736251ac95 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:21.144666 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bdf0938a-4816-4049-b68a-d9736251ac95 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:21.145220 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bdf0938a-4816-4049-b68a-d9736251ac95 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:21.145683 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bdf0938a-4816-4049-b68a-d9736251ac95 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:21.152012 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-e2b50f95-52c5-40e8-9710-a733840a9541 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Getting quotas for project c306d09e93584320b34697dba7641ac8. Resources: {'key_pairs'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:37:21.156331 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-e2b50f95-52c5-40e8-9710-a733840a9541 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Getting quotas for user df0ffa9f450642cc94ed828cb34034b5 and project c306d09e93584320b34697dba7641ac8. Resources: {'key_pairs'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:37:21.257578 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e2b50f95-52c5-40e8-9710-a733840a9541 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.345248 Sep 03 01:37:21.258228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 347/683] 10.222.0.13 () {60 vars in 1159 bytes} [Sat Sep 3 01:37:20 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:21.263065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-a99249c5-8a9d-4103-82a1-bb0b6cb22391 req-8c3a8ae7-31e0-4cc1-ae3d-161438147652 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34abe46a-5361-4e96-a952-5909fad8c4f4", "tag": "885d8df4-2f3f-463e-aa94-cb8b3ae9cb29"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:21.274141 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a99249c5-8a9d-4103-82a1-bb0b6cb22391 req-8c3a8ae7-31e0-4cc1-ae3d-161438147652 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:21.274643 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a99249c5-8a9d-4103-82a1-bb0b6cb22391 req-8c3a8ae7-31e0-4cc1-ae3d-161438147652 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:21.275060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a99249c5-8a9d-4103-82a1-bb0b6cb22391 req-8c3a8ae7-31e0-4cc1-ae3d-161438147652 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:21.286646 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-a99249c5-8a9d-4103-82a1-bb0b6cb22391 req-8c3a8ae7-31e0-4cc1-ae3d-161438147652 service nova] Creating event network-changed:885d8df4-2f3f-463e-aa94-cb8b3ae9cb29 for instance 34abe46a-5361-4e96-a952-5909fad8c4f4 on hv-cinder-83800 Sep 03 01:37:21.292210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-a99249c5-8a9d-4103-82a1-bb0b6cb22391 req-8c3a8ae7-31e0-4cc1-ae3d-161438147652 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032818 Sep 03 01:37:21.293182 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 348/684] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:21.298930 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9fa3955f-3bb3-4512-a608-f94e6bc56b06 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:21.299643 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9fa3955f-3bb3-4512-a608-f94e6bc56b06 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:21.305843 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9fa3955f-3bb3-4512-a608-f94e6bc56b06 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:21.306278 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9fa3955f-3bb3-4512-a608-f94e6bc56b06 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:21.306742 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9fa3955f-3bb3-4512-a608-f94e6bc56b06 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:21.307433 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9fa3955f-3bb3-4512-a608-f94e6bc56b06 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:21.307874 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9fa3955f-3bb3-4512-a608-f94e6bc56b06 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:21.308293 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9fa3955f-3bb3-4512-a608-f94e6bc56b06 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:21.317713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bdf0938a-4816-4049-b68a-d9736251ac95 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:21.325863 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bdf0938a-4816-4049-b68a-d9736251ac95 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1665 microversion: 2.1 time: 0.200638 Sep 03 01:37:21.326670 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 337/685] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:21 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1665 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:21.543748 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9fa3955f-3bb3-4512-a608-f94e6bc56b06 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:21.557926 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9fa3955f-3bb3-4512-a608-f94e6bc56b06 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:21.561171 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9fa3955f-3bb3-4512-a608-f94e6bc56b06 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:21.563307 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9fa3955f-3bb3-4512-a608-f94e6bc56b06 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1796 microversion: 2.20 time: 0.268183 Sep 03 01:37:21.564976 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 349/686] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:37:21 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1796 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:37:21.887128 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f217d43e-e84c-4077-b8e4-519582d4a396 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:21.887783 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f217d43e-e84c-4077-b8e4-519582d4a396 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:21.894807 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f217d43e-e84c-4077-b8e4-519582d4a396 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:21.895496 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f217d43e-e84c-4077-b8e4-519582d4a396 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:21.896023 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f217d43e-e84c-4077-b8e4-519582d4a396 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:21.896633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f217d43e-e84c-4077-b8e4-519582d4a396 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:21.898443 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f217d43e-e84c-4077-b8e4-519582d4a396 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:21.898443 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f217d43e-e84c-4077-b8e4-519582d4a396 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:22.038250 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ef5db49c-cfd5-4569-a949-9e543dfd5d2a tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:22.039004 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ef5db49c-cfd5-4569-a949-9e543dfd5d2a tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:22.047000 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef5db49c-cfd5-4569-a949-9e543dfd5d2a tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:22.049375 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef5db49c-cfd5-4569-a949-9e543dfd5d2a tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:22.049986 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef5db49c-cfd5-4569-a949-9e543dfd5d2a tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:22.050943 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef5db49c-cfd5-4569-a949-9e543dfd5d2a tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:22.051549 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef5db49c-cfd5-4569-a949-9e543dfd5d2a tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:22.052139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef5db49c-cfd5-4569-a949-9e543dfd5d2a tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:22.175230 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-f217d43e-e84c-4077-b8e4-519582d4a396 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:22.190290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f217d43e-e84c-4077-b8e4-519582d4a396 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1681 microversion: 2.1 time: 0.306923 Sep 03 01:37:22.192259 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 338/687] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:21 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1681 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:22.356081 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d4e2101b-e0c2-4998-bab2-405c42b94016 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:22.356450 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d4e2101b-e0c2-4998-bab2-405c42b94016 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:22.366479 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4e2101b-e0c2-4998-bab2-405c42b94016 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:22.368316 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4e2101b-e0c2-4998-bab2-405c42b94016 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:22.369131 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4e2101b-e0c2-4998-bab2-405c42b94016 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:22.371138 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4e2101b-e0c2-4998-bab2-405c42b94016 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:22.376350 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4e2101b-e0c2-4998-bab2-405c42b94016 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:22.376350 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4e2101b-e0c2-4998-bab2-405c42b94016 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:22.429106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ef5db49c-cfd5-4569-a949-9e543dfd5d2a tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:22.446890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ef5db49c-cfd5-4569-a949-9e543dfd5d2a tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1318 microversion: 2.1 time: 0.411822 Sep 03 01:37:22.448233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 350/688] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:22 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:22.713566 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d4e2101b-e0c2-4998-bab2-405c42b94016 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:22.726831 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d4e2101b-e0c2-4998-bab2-405c42b94016 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1665 microversion: 2.1 time: 0.378414 Sep 03 01:37:22.728101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 339/689] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:22 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1665 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:23.221659 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0e88ae1c-c750-43b1-b77f-72529fb6b084 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:23.224025 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0e88ae1c-c750-43b1-b77f-72529fb6b084 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:23.234607 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0e88ae1c-c750-43b1-b77f-72529fb6b084 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:23.235571 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0e88ae1c-c750-43b1-b77f-72529fb6b084 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:23.238271 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0e88ae1c-c750-43b1-b77f-72529fb6b084 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:23.240065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0e88ae1c-c750-43b1-b77f-72529fb6b084 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:23.240851 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0e88ae1c-c750-43b1-b77f-72529fb6b084 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:23.241819 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0e88ae1c-c750-43b1-b77f-72529fb6b084 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:23.350041 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0e88ae1c-c750-43b1-b77f-72529fb6b084 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:23.359185 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0e88ae1c-c750-43b1-b77f-72529fb6b084 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1613 microversion: 2.1 time: 0.146974 Sep 03 01:37:23.360421 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 351/690] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:23 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1613 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:23.471612 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8790cc67-91e0-47a8-b16a-cd2ada849faa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:23.472367 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8790cc67-91e0-47a8-b16a-cd2ada849faa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:23.480953 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8790cc67-91e0-47a8-b16a-cd2ada849faa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:23.481586 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8790cc67-91e0-47a8-b16a-cd2ada849faa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:23.482118 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8790cc67-91e0-47a8-b16a-cd2ada849faa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:23.482959 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8790cc67-91e0-47a8-b16a-cd2ada849faa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:23.483585 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8790cc67-91e0-47a8-b16a-cd2ada849faa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:23.484186 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8790cc67-91e0-47a8-b16a-cd2ada849faa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:23.676899 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8790cc67-91e0-47a8-b16a-cd2ada849faa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:23.687472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8790cc67-91e0-47a8-b16a-cd2ada849faa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1506 microversion: 2.1 time: 0.217808 Sep 03 01:37:23.705251 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 340/691] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:23 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:23.761765 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-fa4f196c-399f-4de8-9d79-37a6a43f10f3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:23.762620 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-fa4f196c-399f-4de8-9d79-37a6a43f10f3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:23.775578 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fa4f196c-399f-4de8-9d79-37a6a43f10f3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:23.776645 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fa4f196c-399f-4de8-9d79-37a6a43f10f3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:23.778110 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fa4f196c-399f-4de8-9d79-37a6a43f10f3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:23.787073 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fa4f196c-399f-4de8-9d79-37a6a43f10f3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:23.792241 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fa4f196c-399f-4de8-9d79-37a6a43f10f3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:23.793143 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fa4f196c-399f-4de8-9d79-37a6a43f10f3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:23.812291 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-4e70aaa5-4018-4df5-954b-2ab8d6f1cd18 req-2367f91f-2135-4c82-8c0b-fac34e36320a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb", "name": "network-vif-deleted", "tag": "fc3e436d-fb1a-441d-bc04-3d6a3d3a5bc4"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:23.847667 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-4e70aaa5-4018-4df5-954b-2ab8d6f1cd18 req-2367f91f-2135-4c82-8c0b-fac34e36320a service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:23.849551 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-4e70aaa5-4018-4df5-954b-2ab8d6f1cd18 req-2367f91f-2135-4c82-8c0b-fac34e36320a service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:23.854260 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-4e70aaa5-4018-4df5-954b-2ab8d6f1cd18 req-2367f91f-2135-4c82-8c0b-fac34e36320a service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:23.897908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-4e70aaa5-4018-4df5-954b-2ab8d6f1cd18 req-2367f91f-2135-4c82-8c0b-fac34e36320a service nova] Creating event network-vif-deleted:fc3e436d-fb1a-441d-bc04-3d6a3d3a5bc4 for instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb on hv-cinder-83800 Sep 03 01:37:23.911064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-4e70aaa5-4018-4df5-954b-2ab8d6f1cd18 req-2367f91f-2135-4c82-8c0b-fac34e36320a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102586 Sep 03 01:37:23.914956 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 341/692] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:24.245479 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-fa4f196c-399f-4de8-9d79-37a6a43f10f3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:24.324784 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-fa4f196c-399f-4de8-9d79-37a6a43f10f3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1665 microversion: 2.1 time: 0.566589 Sep 03 01:37:24.325935 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 352/693] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:23 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1665 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:24.388430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:24.389387 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:24.405401 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:24.406857 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:24.410092 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:24.411314 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:24.412076 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:24.412998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:24.422044 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:24.459851 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=100 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:24.464666 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:24.465495 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:24.466272 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:24.467580 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lazy-loading 'fault' on Instance uuid 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:37:24.573435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:24.612171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9142ac2c-029b-45b3-b750-93b20163817d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1331 microversion: 2.1 time: 0.223760 Sep 03 01:37:24.650462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 342/694] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:24 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1331 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:25.362115 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2e5dc217-695b-4f0e-9958-1cd6e589c81a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:25.362763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2e5dc217-695b-4f0e-9958-1cd6e589c81a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:25.369122 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2e5dc217-695b-4f0e-9958-1cd6e589c81a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:25.369616 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2e5dc217-695b-4f0e-9958-1cd6e589c81a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:25.370057 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2e5dc217-695b-4f0e-9958-1cd6e589c81a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:25.370800 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2e5dc217-695b-4f0e-9958-1cd6e589c81a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:25.371261 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2e5dc217-695b-4f0e-9958-1cd6e589c81a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:25.371692 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2e5dc217-695b-4f0e-9958-1cd6e589c81a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:25.395451 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:25.553336 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2e5dc217-695b-4f0e-9958-1cd6e589c81a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:25.570191 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2e5dc217-695b-4f0e-9958-1cd6e589c81a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1669 microversion: 2.1 time: 0.212806 Sep 03 01:37:25.578833 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 353/695] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:25 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1669 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:25.637426 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:25.638023 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:25.646294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:25.646924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:25.647427 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:25.648397 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:25.649100 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:25.649707 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:25.696307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:25.696799 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:25.697269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:25.697764 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lazy-loading 'fault' on Instance uuid 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:37:25.765197 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:25.772505 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2e593929-914f-46b8-b726-68bc703b033a tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 200 len: 1331 microversion: 2.1 time: 0.139259 Sep 03 01:37:25.773528 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 343/696] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:25 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 1331 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:26.796789 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2538cf79-7a2a-403f-b6b6-929e54ffa447 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:26.797411 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2538cf79-7a2a-403f-b6b6-929e54ffa447 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:26.805151 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2538cf79-7a2a-403f-b6b6-929e54ffa447 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:26.805441 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2538cf79-7a2a-403f-b6b6-929e54ffa447 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:26.805883 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2538cf79-7a2a-403f-b6b6-929e54ffa447 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:26.806607 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2538cf79-7a2a-403f-b6b6-929e54ffa447 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:26.807066 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2538cf79-7a2a-403f-b6b6-929e54ffa447 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:26.807497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2538cf79-7a2a-403f-b6b6-929e54ffa447 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:26.821908 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-2538cf79-7a2a-403f-b6b6-929e54ffa447 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2538cf79-7a2a-403f-b6b6-929e54ffa447 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb HTTP/1.1 Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:37:26.823567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:37:26.825177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:37:26.825177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:37:26.825177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:37:26.825177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:37:26.825177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:37:26.825177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:37:26.825177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:37:26.825177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:37:26.825177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:37:26.825177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:37:26.825177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:37:26.825177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb'} Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:37:26.826042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:37:26.827300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:37:26.828413 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2538cf79-7a2a-403f-b6b6-929e54ffa447 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 404 to user: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:37:26.828413 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2538cf79-7a2a-403f-b6b6-929e54ffa447 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 404 len: 111 microversion: 2.1 time: 0.032015 Sep 03 01:37:26.828413 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 354/697] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:26 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:37:26.834611 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0cd7de8c-9d9e-4d8c-90c3-83316ae31a56 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '.version_select at 0x7f6d24939550>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:26.909533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0cd7de8c-9d9e-4d8c-90c3-83316ae31a56 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118907697" status: 202 len: 0 microversion: 2.1 time: 0.079241 Sep 03 01:37:26.910125 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 344/698] 10.222.0.13 () {58 vars in 1221 bytes} [Sat Sep 3 01:37:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118907697 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:37:27.700724 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-27adacc9-4f99-4dc2-a08f-9c4dc3880e15 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Action: 'create', calling method: .version_select at 0x7f6d24b01790>, body: {"keypair": {"name": "tempest-keypair-787952500", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHGOV+Imz2GkV1/WdP66DpGkX6aUq6rDKXF3eN35CQjJKhEKSXXItdZqowqjtEKIYoOy9V8xzzaKgfXxi7n60OcUXg3ZZeLf8rwSmhudAZmCCc/IUoaAUDxu4mUJ5JBe3Q=="}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:27.716941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-27adacc9-4f99-4dc2-a08f-9c4dc3880e15 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for project 02813cf0683749ee87b039b28f1aeebb. Resources: {'key_pairs'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:37:27.719035 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:27.721256 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-27adacc9-4f99-4dc2-a08f-9c4dc3880e15 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for user 2b9ab1983bb84318b509878b930e9402 and project 02813cf0683749ee87b039b28f1aeebb. Resources: {'key_pairs'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:37:27.804385 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-27adacc9-4f99-4dc2-a08f-9c4dc3880e15 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.107431 Sep 03 01:37:27.805351 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 355/699] 10.222.0.13 () {60 vars in 1159 bytes} [Sat Sep 3 01:37:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:29.512525 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-14ced19a-5d35-4796-8741-33b43acecbf2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:29.515190 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-14ced19a-5d35-4796-8741-33b43acecbf2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:29.523377 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-14ced19a-5d35-4796-8741-33b43acecbf2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:29.523884 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-14ced19a-5d35-4796-8741-33b43acecbf2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:29.524412 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-14ced19a-5d35-4796-8741-33b43acecbf2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:29.525164 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-14ced19a-5d35-4796-8741-33b43acecbf2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:29.525801 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-14ced19a-5d35-4796-8741-33b43acecbf2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:29.526198 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-14ced19a-5d35-4796-8741-33b43acecbf2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:29.728079 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-14ced19a-5d35-4796-8741-33b43acecbf2 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "POST /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/action" status: 202 len: 0 microversion: 2.1 time: 0.220425 Sep 03 01:37:29.728709 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 345/700] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:37:29 2022] POST /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:37:29.738597 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6d3a97e4-ced0-46e5-a523-c1daae922c03 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:29.740000 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6d3a97e4-ced0-46e5-a523-c1daae922c03 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:29.747196 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6d3a97e4-ced0-46e5-a523-c1daae922c03 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:29.748235 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6d3a97e4-ced0-46e5-a523-c1daae922c03 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:29.748937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6d3a97e4-ced0-46e5-a523-c1daae922c03 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:29.749722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6d3a97e4-ced0-46e5-a523-c1daae922c03 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:29.750206 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6d3a97e4-ced0-46e5-a523-c1daae922c03 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:29.750647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6d3a97e4-ced0-46e5-a523-c1daae922c03 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:29.977459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6d3a97e4-ced0-46e5-a523-c1daae922c03 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:29.991576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6d3a97e4-ced0-46e5-a523-c1daae922c03 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1753 microversion: 2.1 time: 0.257923 Sep 03 01:37:29.992635 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 356/701] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:29 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1753 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:30.089910 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-740031096", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7bd92e7f-f880-47a6-a573-413ea7d8bd54"}], "security_groups": [{"name": "tempest-securitygroup--243270725"}], "key_name": "tempest-keypair-787952500", "user_data": "}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:31.020602 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d24ac434-d16b-4324-91f3-db0b7621024b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:31.024220 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d24ac434-d16b-4324-91f3-db0b7621024b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:31.027557 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d24ac434-d16b-4324-91f3-db0b7621024b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:31.028036 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d24ac434-d16b-4324-91f3-db0b7621024b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:31.028469 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d24ac434-d16b-4324-91f3-db0b7621024b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:31.029155 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d24ac434-d16b-4324-91f3-db0b7621024b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:31.029605 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d24ac434-d16b-4324-91f3-db0b7621024b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:31.030028 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d24ac434-d16b-4324-91f3-db0b7621024b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:31.182006 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d24ac434-d16b-4324-91f3-db0b7621024b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:31.190503 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d24ac434-d16b-4324-91f3-db0b7621024b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.173825 Sep 03 01:37:31.191070 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 357/702] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:31 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:32.214656 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-70d94382-3918-4659-83a8-c09b8c0947c4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:32.215372 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-70d94382-3918-4659-83a8-c09b8c0947c4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:32.221909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-70d94382-3918-4659-83a8-c09b8c0947c4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:32.222418 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-70d94382-3918-4659-83a8-c09b8c0947c4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:32.222853 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-70d94382-3918-4659-83a8-c09b8c0947c4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:32.223549 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-70d94382-3918-4659-83a8-c09b8c0947c4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:32.224001 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-70d94382-3918-4659-83a8-c09b8c0947c4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:32.224424 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-70d94382-3918-4659-83a8-c09b8c0947c4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:32.370697 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-70d94382-3918-4659-83a8-c09b8c0947c4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:32.379391 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-70d94382-3918-4659-83a8-c09b8c0947c4 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.168714 Sep 03 01:37:32.379963 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 358/703] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:32 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:33.402768 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5f19f89f-8604-4a05-ae35-399e788002a5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:33.403414 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5f19f89f-8604-4a05-ae35-399e788002a5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:33.409556 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f19f89f-8604-4a05-ae35-399e788002a5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:33.410036 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f19f89f-8604-4a05-ae35-399e788002a5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:33.410506 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f19f89f-8604-4a05-ae35-399e788002a5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:33.411199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f19f89f-8604-4a05-ae35-399e788002a5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:33.411646 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f19f89f-8604-4a05-ae35-399e788002a5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:33.412078 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f19f89f-8604-4a05-ae35-399e788002a5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:33.556157 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5f19f89f-8604-4a05-ae35-399e788002a5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:33.568290 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5f19f89f-8604-4a05-ae35-399e788002a5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.169267 Sep 03 01:37:33.568880 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 359/704] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:33 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:34.591758 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-fe4fbe89-c5af-430a-8440-1fe8b9b91874 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:34.592628 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-fe4fbe89-c5af-430a-8440-1fe8b9b91874 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:34.599587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe4fbe89-c5af-430a-8440-1fe8b9b91874 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:34.600188 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe4fbe89-c5af-430a-8440-1fe8b9b91874 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:34.600630 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe4fbe89-c5af-430a-8440-1fe8b9b91874 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:34.601333 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe4fbe89-c5af-430a-8440-1fe8b9b91874 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:34.601783 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe4fbe89-c5af-430a-8440-1fe8b9b91874 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:34.602208 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe4fbe89-c5af-430a-8440-1fe8b9b91874 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:34.750293 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-fe4fbe89-c5af-430a-8440-1fe8b9b91874 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:34.758584 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-fe4fbe89-c5af-430a-8440-1fe8b9b91874 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.171039 Sep 03 01:37:34.759174 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 360/705] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:34 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:35.781060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-fb05b2bd-a247-48f4-9232-68965ec0b576 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:35.781728 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-fb05b2bd-a247-48f4-9232-68965ec0b576 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:35.788139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fb05b2bd-a247-48f4-9232-68965ec0b576 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:35.788613 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fb05b2bd-a247-48f4-9232-68965ec0b576 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:35.789042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fb05b2bd-a247-48f4-9232-68965ec0b576 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:35.789713 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fb05b2bd-a247-48f4-9232-68965ec0b576 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:35.790156 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fb05b2bd-a247-48f4-9232-68965ec0b576 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:35.790598 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fb05b2bd-a247-48f4-9232-68965ec0b576 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:35.941777 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-fb05b2bd-a247-48f4-9232-68965ec0b576 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:35.949866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-fb05b2bd-a247-48f4-9232-68965ec0b576 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.172764 Sep 03 01:37:35.950456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 361/706] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:35 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:36.972731 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-22ac6d2e-efb8-4c7b-bebf-964b5295b0ac tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:36.973399 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-22ac6d2e-efb8-4c7b-bebf-964b5295b0ac tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:36.979292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22ac6d2e-efb8-4c7b-bebf-964b5295b0ac tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:36.979775 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22ac6d2e-efb8-4c7b-bebf-964b5295b0ac tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:36.980203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22ac6d2e-efb8-4c7b-bebf-964b5295b0ac tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:36.980879 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22ac6d2e-efb8-4c7b-bebf-964b5295b0ac tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:36.981358 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22ac6d2e-efb8-4c7b-bebf-964b5295b0ac tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:36.981794 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-22ac6d2e-efb8-4c7b-bebf-964b5295b0ac tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:37.136582 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-22ac6d2e-efb8-4c7b-bebf-964b5295b0ac tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:37.145824 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-22ac6d2e-efb8-4c7b-bebf-964b5295b0ac tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.177497 Sep 03 01:37:37.146523 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 362/707] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:36 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:38.170772 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-91063418-c628-456e-89ac-fe57ee41820d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:38.171428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-91063418-c628-456e-89ac-fe57ee41820d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:38.173212 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=8 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:38.178587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-91063418-c628-456e-89ac-fe57ee41820d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:38.183959 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-91063418-c628-456e-89ac-fe57ee41820d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:38.183959 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-91063418-c628-456e-89ac-fe57ee41820d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:38.183959 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-91063418-c628-456e-89ac-fe57ee41820d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:38.183959 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-91063418-c628-456e-89ac-fe57ee41820d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:38.184344 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-91063418-c628-456e-89ac-fe57ee41820d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:38.323469 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-91063418-c628-456e-89ac-fe57ee41820d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:38.335908 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-91063418-c628-456e-89ac-fe57ee41820d tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.168743 Sep 03 01:37:38.337383 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 363/708] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:38 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:39.363152 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5e7efd3d-26e4-46d5-a959-f63834e064a1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:39.363843 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5e7efd3d-26e4-46d5-a959-f63834e064a1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:39.369609 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5e7efd3d-26e4-46d5-a959-f63834e064a1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:39.370080 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5e7efd3d-26e4-46d5-a959-f63834e064a1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:39.370547 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5e7efd3d-26e4-46d5-a959-f63834e064a1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:39.371415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5e7efd3d-26e4-46d5-a959-f63834e064a1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:39.371871 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5e7efd3d-26e4-46d5-a959-f63834e064a1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:39.372290 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5e7efd3d-26e4-46d5-a959-f63834e064a1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:39.524764 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5e7efd3d-26e4-46d5-a959-f63834e064a1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:39.533104 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5e7efd3d-26e4-46d5-a959-f63834e064a1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.174465 Sep 03 01:37:39.533673 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 364/709] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:39 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:39.651717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:40.100358 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:40.557342 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-83c057bb-5a20-477d-aabe-2271b37411fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:40.557943 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-83c057bb-5a20-477d-aabe-2271b37411fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:40.563956 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-83c057bb-5a20-477d-aabe-2271b37411fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:40.564427 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-83c057bb-5a20-477d-aabe-2271b37411fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:40.564855 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-83c057bb-5a20-477d-aabe-2271b37411fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:40.565526 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-83c057bb-5a20-477d-aabe-2271b37411fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:40.566045 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-83c057bb-5a20-477d-aabe-2271b37411fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:40.566659 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-83c057bb-5a20-477d-aabe-2271b37411fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:40.720759 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-83c057bb-5a20-477d-aabe-2271b37411fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:40.729930 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-83c057bb-5a20-477d-aabe-2271b37411fd tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.176378 Sep 03 01:37:40.730562 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 365/710] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:40 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:41.756723 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-77ba7348-bf9c-4c92-a8da-c86e9217511e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:41.763673 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-77ba7348-bf9c-4c92-a8da-c86e9217511e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:41.763673 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-77ba7348-bf9c-4c92-a8da-c86e9217511e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:41.764183 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-77ba7348-bf9c-4c92-a8da-c86e9217511e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:41.764635 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-77ba7348-bf9c-4c92-a8da-c86e9217511e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:41.765314 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-77ba7348-bf9c-4c92-a8da-c86e9217511e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:41.765760 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-77ba7348-bf9c-4c92-a8da-c86e9217511e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:41.766175 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-77ba7348-bf9c-4c92-a8da-c86e9217511e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:41.916611 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-77ba7348-bf9c-4c92-a8da-c86e9217511e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:41.925970 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-77ba7348-bf9c-4c92-a8da-c86e9217511e tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.174392 Sep 03 01:37:41.926676 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 366/711] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:41 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:42.786453 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.network.neutron [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] validate_networks() for [('7bd92e7f-f880-47a6-a573-413ea7d8bd54', None, None, None, None, None)] {{(pid=127553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:37:42.949040 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a13772ee-9df2-42ce-96cd-31576806a631 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:42.949648 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a13772ee-9df2-42ce-96cd-31576806a631 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:42.955658 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a13772ee-9df2-42ce-96cd-31576806a631 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:42.956145 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a13772ee-9df2-42ce-96cd-31576806a631 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:42.956608 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a13772ee-9df2-42ce-96cd-31576806a631 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:42.957403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a13772ee-9df2-42ce-96cd-31576806a631 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:42.957867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a13772ee-9df2-42ce-96cd-31576806a631 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:42.958312 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a13772ee-9df2-42ce-96cd-31576806a631 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:43.111230 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a13772ee-9df2-42ce-96cd-31576806a631 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:43.119653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a13772ee-9df2-42ce-96cd-31576806a631 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.174458 Sep 03 01:37:43.120239 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 367/712] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:42 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:43.392730 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Flavor limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:37:43.393150 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Image limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:37:43.393617 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Flavor pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:37:43.394215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Image pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:37:43.394714 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:37:43.404171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:43.404690 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:43.405179 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:43.405977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:43.406507 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:43.407067 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:43.429813 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for project 02813cf0683749ee87b039b28f1aeebb. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:37:43.433999 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for user 2b9ab1983bb84318b509878b930e9402 and project 02813cf0683749ee87b039b28f1aeebb. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:37:43.444954 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Going to run 1 instances... {{(pid=127553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:37:43.447576 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:37:43.542863 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [6040fca8-d285-4575-931a-b412ee9df3ba] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 01:37:44.143566 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b3f1ab4d-a918-4203-9e7c-c3e8a81a1ad0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:44.144842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b3f1ab4d-a918-4203-9e7c-c3e8a81a1ad0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:44.151516 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b3f1ab4d-a918-4203-9e7c-c3e8a81a1ad0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:44.151989 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b3f1ab4d-a918-4203-9e7c-c3e8a81a1ad0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:44.152483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b3f1ab4d-a918-4203-9e7c-c3e8a81a1ad0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:44.153243 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b3f1ab4d-a918-4203-9e7c-c3e8a81a1ad0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:44.153731 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b3f1ab4d-a918-4203-9e7c-c3e8a81a1ad0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:44.154213 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b3f1ab4d-a918-4203-9e7c-c3e8a81a1ad0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:44.299218 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b3f1ab4d-a918-4203-9e7c-c3e8a81a1ad0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:44.309199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b3f1ab4d-a918-4203-9e7c-c3e8a81a1ad0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.169796 Sep 03 01:37:44.309783 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 368/713] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:44 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:44.553071 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO oslo.messaging._drivers.impl_rabbit [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [6040fca8-d285-4575-931a-b412ee9df3ba] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 48978. Sep 03 01:37:44.557299 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5928a739-4d74-430c-b52b-3785acea1c0c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 14.472076 Sep 03 01:37:44.557916 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 346/714] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:37:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 14474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 01:37:44.569958 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9ea9e30c-af67-4f99-873e-ecdc95d0be19 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:44.570712 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9ea9e30c-af67-4f99-873e-ecdc95d0be19 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:44.622615 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9ea9e30c-af67-4f99-873e-ecdc95d0be19 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:44.629315 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9ea9e30c-af67-4f99-873e-ecdc95d0be19 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1240 microversion: 2.1 time: 0.064132 Sep 03 01:37:44.630872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 369/715] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:44 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:45.335294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-591cae77-4ca3-4a6b-b413-3ea5bb40695b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:45.335904 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-591cae77-4ca3-4a6b-b413-3ea5bb40695b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:45.342937 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-591cae77-4ca3-4a6b-b413-3ea5bb40695b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:45.343465 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-591cae77-4ca3-4a6b-b413-3ea5bb40695b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:45.343943 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-591cae77-4ca3-4a6b-b413-3ea5bb40695b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:45.344698 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-591cae77-4ca3-4a6b-b413-3ea5bb40695b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:45.345231 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-591cae77-4ca3-4a6b-b413-3ea5bb40695b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:45.345684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-591cae77-4ca3-4a6b-b413-3ea5bb40695b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:45.494116 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-591cae77-4ca3-4a6b-b413-3ea5bb40695b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:45.502497 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-591cae77-4ca3-4a6b-b413-3ea5bb40695b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.171907 Sep 03 01:37:45.504409 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 347/716] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:45 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:45.653085 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-14726f75-c695-40ea-9bdd-90da974a4b43 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:45.653593 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-14726f75-c695-40ea-9bdd-90da974a4b43 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:45.659798 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14726f75-c695-40ea-9bdd-90da974a4b43 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:45.660295 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14726f75-c695-40ea-9bdd-90da974a4b43 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:45.660747 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14726f75-c695-40ea-9bdd-90da974a4b43 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:45.661438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14726f75-c695-40ea-9bdd-90da974a4b43 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:45.661892 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14726f75-c695-40ea-9bdd-90da974a4b43 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:45.662316 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14726f75-c695-40ea-9bdd-90da974a4b43 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:45.725920 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-14726f75-c695-40ea-9bdd-90da974a4b43 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:45.733847 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-14726f75-c695-40ea-9bdd-90da974a4b43 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1244 microversion: 2.1 time: 0.084693 Sep 03 01:37:45.734531 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 370/717] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:45 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:46.526642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ccaa106e-183c-434a-9a04-db96631619fe tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:46.527246 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ccaa106e-183c-434a-9a04-db96631619fe tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:46.533852 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ccaa106e-183c-434a-9a04-db96631619fe tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:46.534348 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ccaa106e-183c-434a-9a04-db96631619fe tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:46.534798 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ccaa106e-183c-434a-9a04-db96631619fe tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:46.535484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ccaa106e-183c-434a-9a04-db96631619fe tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:46.535933 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ccaa106e-183c-434a-9a04-db96631619fe tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:46.536355 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ccaa106e-183c-434a-9a04-db96631619fe tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:46.680901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ccaa106e-183c-434a-9a04-db96631619fe tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:46.689130 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ccaa106e-183c-434a-9a04-db96631619fe tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.166299 Sep 03 01:37:46.689697 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 348/718] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:46 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:46.757034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-704b1457-687b-424e-b267-ac1ed5c628e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:46.757727 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-704b1457-687b-424e-b267-ac1ed5c628e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:46.763662 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-704b1457-687b-424e-b267-ac1ed5c628e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:46.764145 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-704b1457-687b-424e-b267-ac1ed5c628e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:46.764576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-704b1457-687b-424e-b267-ac1ed5c628e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:46.765266 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-704b1457-687b-424e-b267-ac1ed5c628e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:46.765722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-704b1457-687b-424e-b267-ac1ed5c628e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:46.766143 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-704b1457-687b-424e-b267-ac1ed5c628e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:46.845588 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-704b1457-687b-424e-b267-ac1ed5c628e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:46.856448 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-704b1457-687b-424e-b267-ac1ed5c628e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1292 microversion: 2.1 time: 0.103033 Sep 03 01:37:46.857491 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 371/719] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:46 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1292 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:47.716081 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-560a96a4-aab3-4013-bc11-0d2db6ec0d5b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:47.717005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-560a96a4-aab3-4013-bc11-0d2db6ec0d5b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:47.726576 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-560a96a4-aab3-4013-bc11-0d2db6ec0d5b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:47.727113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-560a96a4-aab3-4013-bc11-0d2db6ec0d5b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:47.727546 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-560a96a4-aab3-4013-bc11-0d2db6ec0d5b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:47.728243 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-560a96a4-aab3-4013-bc11-0d2db6ec0d5b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:47.728728 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-560a96a4-aab3-4013-bc11-0d2db6ec0d5b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:47.729153 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-560a96a4-aab3-4013-bc11-0d2db6ec0d5b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:47.882209 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-795f1de4-12b6-4c26-822a-86fbfe7801f4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:47.882800 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-795f1de4-12b6-4c26-822a-86fbfe7801f4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:47.886664 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-560a96a4-aab3-4013-bc11-0d2db6ec0d5b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:47.897804 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-560a96a4-aab3-4013-bc11-0d2db6ec0d5b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.187467 Sep 03 01:37:47.899044 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-795f1de4-12b6-4c26-822a-86fbfe7801f4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:47.899735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-795f1de4-12b6-4c26-822a-86fbfe7801f4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:47.900745 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-795f1de4-12b6-4c26-822a-86fbfe7801f4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:47.902257 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 349/720] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:47 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:47.903139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-795f1de4-12b6-4c26-822a-86fbfe7801f4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:47.903898 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-795f1de4-12b6-4c26-822a-86fbfe7801f4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:47.910220 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-795f1de4-12b6-4c26-822a-86fbfe7801f4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:48.116212 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-795f1de4-12b6-4c26-822a-86fbfe7801f4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:48.122834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:48.135060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-795f1de4-12b6-4c26-822a-86fbfe7801f4 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1365 microversion: 2.1 time: 0.248479 Sep 03 01:37:48.137312 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 372/721] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:47 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1365 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:48.924509 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f2d8aae5-c074-43f9-8252-de499d813d25 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:48.925110 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f2d8aae5-c074-43f9-8252-de499d813d25 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:48.932167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f2d8aae5-c074-43f9-8252-de499d813d25 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:48.932706 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f2d8aae5-c074-43f9-8252-de499d813d25 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:48.933137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f2d8aae5-c074-43f9-8252-de499d813d25 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:48.933815 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f2d8aae5-c074-43f9-8252-de499d813d25 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:48.934261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f2d8aae5-c074-43f9-8252-de499d813d25 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:48.934740 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f2d8aae5-c074-43f9-8252-de499d813d25 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:48.994248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-a99b470c-47cf-47c2-8d73-3bffb4fa2bdd req-fe13e7c4-5a04-4ab5-b500-a7afa84891ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb78ff3-5840-45d5-8185-450243588142", "tag": "d45b0a37-c43a-46e4-8121-1008ccf616f3"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:49.009964 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a99b470c-47cf-47c2-8d73-3bffb4fa2bdd req-fe13e7c4-5a04-4ab5-b500-a7afa84891ef service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:49.013309 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a99b470c-47cf-47c2-8d73-3bffb4fa2bdd req-fe13e7c4-5a04-4ab5-b500-a7afa84891ef service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:49.014864 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a99b470c-47cf-47c2-8d73-3bffb4fa2bdd req-fe13e7c4-5a04-4ab5-b500-a7afa84891ef service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:49.035901 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-a99b470c-47cf-47c2-8d73-3bffb4fa2bdd req-fe13e7c4-5a04-4ab5-b500-a7afa84891ef service nova] Creating event network-changed:d45b0a37-c43a-46e4-8121-1008ccf616f3 for instance 3fb78ff3-5840-45d5-8185-450243588142 on hv-cinder-83800 Sep 03 01:37:49.041914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-a99b470c-47cf-47c2-8d73-3bffb4fa2bdd req-fe13e7c4-5a04-4ab5-b500-a7afa84891ef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052516 Sep 03 01:37:49.042937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 373/722] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:49.098683 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-f2d8aae5-c074-43f9-8252-de499d813d25 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:49.108029 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f2d8aae5-c074-43f9-8252-de499d813d25 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.187385 Sep 03 01:37:49.108620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 350/723] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:48 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:49.160347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6a359b24-e9ae-4d17-8c83-8380faf36db1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:49.161036 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6a359b24-e9ae-4d17-8c83-8380faf36db1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:49.168086 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6a359b24-e9ae-4d17-8c83-8380faf36db1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:49.168580 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6a359b24-e9ae-4d17-8c83-8380faf36db1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:49.169008 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6a359b24-e9ae-4d17-8c83-8380faf36db1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:49.169692 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6a359b24-e9ae-4d17-8c83-8380faf36db1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:49.170138 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6a359b24-e9ae-4d17-8c83-8380faf36db1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:49.170585 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6a359b24-e9ae-4d17-8c83-8380faf36db1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:49.391928 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6a359b24-e9ae-4d17-8c83-8380faf36db1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:49.401152 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6a359b24-e9ae-4d17-8c83-8380faf36db1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1365 microversion: 2.1 time: 0.245191 Sep 03 01:37:49.401835 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 374/724] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:49 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:50.131261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a71a6a5f-75d9-43fd-bf8d-4c4372596a93 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:50.132539 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a71a6a5f-75d9-43fd-bf8d-4c4372596a93 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:50.139500 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a71a6a5f-75d9-43fd-bf8d-4c4372596a93 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:50.139930 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a71a6a5f-75d9-43fd-bf8d-4c4372596a93 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:50.140366 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a71a6a5f-75d9-43fd-bf8d-4c4372596a93 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:50.141058 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a71a6a5f-75d9-43fd-bf8d-4c4372596a93 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:50.141509 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a71a6a5f-75d9-43fd-bf8d-4c4372596a93 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:50.141932 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a71a6a5f-75d9-43fd-bf8d-4c4372596a93 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:50.291409 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a71a6a5f-75d9-43fd-bf8d-4c4372596a93 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:50.299710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a71a6a5f-75d9-43fd-bf8d-4c4372596a93 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.172490 Sep 03 01:37:50.300274 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 351/725] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:50 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:50.304311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c8b8cf4a-8b63-45a9-b303-98b4c2488954 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61aa0d77-7c26-4289-8b30-28dde25da91f", "device": "/dev/sdb"}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:50.307134 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c8b8cf4a-8b63-45a9-b303-98b4c2488954 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:50.312943 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8b8cf4a-8b63-45a9-b303-98b4c2488954 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:50.313423 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8b8cf4a-8b63-45a9-b303-98b4c2488954 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:50.313847 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8b8cf4a-8b63-45a9-b303-98b4c2488954 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:50.314553 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8b8cf4a-8b63-45a9-b303-98b4c2488954 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:50.315000 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8b8cf4a-8b63-45a9-b303-98b4c2488954 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:50.315414 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8b8cf4a-8b63-45a9-b303-98b4c2488954 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:50.424752 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d82830a8-ad92-4cd8-8360-69a4d7bb3fd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:50.425284 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d82830a8-ad92-4cd8-8360-69a4d7bb3fd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:50.431903 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d82830a8-ad92-4cd8-8360-69a4d7bb3fd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:50.432440 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d82830a8-ad92-4cd8-8360-69a4d7bb3fd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:50.432875 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d82830a8-ad92-4cd8-8360-69a4d7bb3fd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:50.433560 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d82830a8-ad92-4cd8-8360-69a4d7bb3fd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:50.434009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d82830a8-ad92-4cd8-8360-69a4d7bb3fd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:50.434460 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d82830a8-ad92-4cd8-8360-69a4d7bb3fd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:50.566136 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d82830a8-ad92-4cd8-8360-69a4d7bb3fd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:50.574113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d82830a8-ad92-4cd8-8360-69a4d7bb3fd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1365 microversion: 2.1 time: 0.153230 Sep 03 01:37:50.574719 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 352/726] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:50 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:51.251311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-666606103", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-467180834", "security_groups": [{"name": "tempest-secgroup-smoke-1200131279"}], "block_device_mapping_v2": [{"uuid": "e1b787cf-08c4-4e59-82a2-c23323538ab6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "acc3f9d7-e89e-4ae5-bc90-4373dd60425f"}]}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:51.370397 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.network.neutron [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] validate_networks() for [('acc3f9d7-e89e-4ae5-bc90-4373dd60425f', None, None, None, None, None)] {{(pid=127553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:37:51.750270 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Flavor limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:37:51.750723 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Image limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:37:51.751194 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Flavor pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:37:51.751635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Image pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:37:51.752046 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:37:51.761088 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:51.761561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:51.761994 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:51.762735 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:51.763186 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:51.763606 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:51.780157 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Getting quotas for project c306d09e93584320b34697dba7641ac8. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:37:51.784262 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Getting quotas for user df0ffa9f450642cc94ed828cb34034b5 and project c306d09e93584320b34697dba7641ac8. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:37:51.843814 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Going to run 1 instances... {{(pid=127553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:37:51.845895 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1b787cf-08c4-4e59-82a2-c23323538ab6',volume_size=None,volume_type=None)] {{(pid=127553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:37:52.019014 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c8b8cf4a-8b63-45a9-b303-98b4c2488954 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "POST /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.719111 Sep 03 01:37:52.019635 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 375/727] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:37:50 2022] POST /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310/os-volume_attachments => generated 194 bytes in 1721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:37:52.025335 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0fe680d0-051d-49f7-8406-aa60bc66d045 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:52.026036 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0fe680d0-051d-49f7-8406-aa60bc66d045 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:52.032722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0fe680d0-051d-49f7-8406-aa60bc66d045 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:52.033238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0fe680d0-051d-49f7-8406-aa60bc66d045 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:52.033701 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0fe680d0-051d-49f7-8406-aa60bc66d045 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:52.034424 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0fe680d0-051d-49f7-8406-aa60bc66d045 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:52.034870 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0fe680d0-051d-49f7-8406-aa60bc66d045 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:52.035289 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0fe680d0-051d-49f7-8406-aa60bc66d045 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:52.191083 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0fe680d0-051d-49f7-8406-aa60bc66d045 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:52.199431 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0fe680d0-051d-49f7-8406-aa60bc66d045 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1758 microversion: 2.1 time: 0.178677 Sep 03 01:37:52.200000 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 376/728] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:52 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1758 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:52.205042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e1e1a864-a3b8-4d5a-bb69-223dd75078b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:52.205646 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e1e1a864-a3b8-4d5a-bb69-223dd75078b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:52.211851 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e1e1a864-a3b8-4d5a-bb69-223dd75078b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:52.212331 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e1e1a864-a3b8-4d5a-bb69-223dd75078b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:52.212769 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e1e1a864-a3b8-4d5a-bb69-223dd75078b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:52.213452 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e1e1a864-a3b8-4d5a-bb69-223dd75078b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:52.213904 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e1e1a864-a3b8-4d5a-bb69-223dd75078b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:52.214327 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e1e1a864-a3b8-4d5a-bb69-223dd75078b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:52.234620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-62cc304d-a442-42ce-a304-942d38ede880 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.987264 Sep 03 01:37:52.235344 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 353/729] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:37:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 01:37:52.247232 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-873c257e-a571-4ec8-b20c-7bf123ca4600 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:52.247895 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-873c257e-a571-4ec8-b20c-7bf123ca4600 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:52.362247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e1e1a864-a3b8-4d5a-bb69-223dd75078b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:52.371205 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e1e1a864-a3b8-4d5a-bb69-223dd75078b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1365 microversion: 2.1 time: 0.170110 Sep 03 01:37:52.371956 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 377/730] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:52 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:52.431230 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-873c257e-a571-4ec8-b20c-7bf123ca4600 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:52.438365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-873c257e-a571-4ec8-b20c-7bf123ca4600 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1093 microversion: 2.1 time: 0.194943 Sep 03 01:37:52.438995 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 354/731] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:52 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1093 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:53.223302 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-437743e8-9308-4e82-b9cd-e14f60b08f3b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:53.224456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-437743e8-9308-4e82-b9cd-e14f60b08f3b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:53.231143 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-437743e8-9308-4e82-b9cd-e14f60b08f3b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:53.231619 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-437743e8-9308-4e82-b9cd-e14f60b08f3b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:53.232050 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-437743e8-9308-4e82-b9cd-e14f60b08f3b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:53.232739 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-437743e8-9308-4e82-b9cd-e14f60b08f3b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:53.233185 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-437743e8-9308-4e82-b9cd-e14f60b08f3b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:53.233605 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-437743e8-9308-4e82-b9cd-e14f60b08f3b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:53.393456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-437743e8-9308-4e82-b9cd-e14f60b08f3b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:53.399857 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2b76fe02-02c4-4167-995c-718feca51b3c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:53.400969 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2b76fe02-02c4-4167-995c-718feca51b3c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:53.408035 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-437743e8-9308-4e82-b9cd-e14f60b08f3b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1761 microversion: 2.1 time: 0.188053 Sep 03 01:37:53.408994 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 378/732] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:53 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1761 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:53.410872 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b76fe02-02c4-4167-995c-718feca51b3c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:53.411519 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b76fe02-02c4-4167-995c-718feca51b3c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:53.412373 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b76fe02-02c4-4167-995c-718feca51b3c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:53.413206 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b76fe02-02c4-4167-995c-718feca51b3c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:53.413722 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b76fe02-02c4-4167-995c-718feca51b3c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:53.414221 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b76fe02-02c4-4167-995c-718feca51b3c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:53.463270 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-51bbf8e1-3bb7-411d-82bf-ce27cc633365 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:53.467090 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-51bbf8e1-3bb7-411d-82bf-ce27cc633365 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:53.473910 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51bbf8e1-3bb7-411d-82bf-ce27cc633365 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:53.474356 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51bbf8e1-3bb7-411d-82bf-ce27cc633365 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:53.474973 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51bbf8e1-3bb7-411d-82bf-ce27cc633365 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:53.475770 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51bbf8e1-3bb7-411d-82bf-ce27cc633365 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:53.476234 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51bbf8e1-3bb7-411d-82bf-ce27cc633365 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:53.476718 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-51bbf8e1-3bb7-411d-82bf-ce27cc633365 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:53.542285 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-51bbf8e1-3bb7-411d-82bf-ce27cc633365 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:53.555049 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-51bbf8e1-3bb7-411d-82bf-ce27cc633365 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1143 microversion: 2.1 time: 0.098066 Sep 03 01:37:53.556085 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2b76fe02-02c4-4167-995c-718feca51b3c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:53.556669 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 379/733] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:53 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1143 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:53.565030 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2b76fe02-02c4-4167-995c-718feca51b3c tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1365 microversion: 2.1 time: 0.172808 Sep 03 01:37:53.566187 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 355/734] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:53 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:54.578224 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b784343e-f418-4d41-b839-13ffdf25feaa tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:54.578862 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b784343e-f418-4d41-b839-13ffdf25feaa tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:54.585554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b784343e-f418-4d41-b839-13ffdf25feaa tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:54.586034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b784343e-f418-4d41-b839-13ffdf25feaa tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:54.586509 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b784343e-f418-4d41-b839-13ffdf25feaa tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:54.587189 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b784343e-f418-4d41-b839-13ffdf25feaa tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:54.587635 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b784343e-f418-4d41-b839-13ffdf25feaa tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:54.588051 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b784343e-f418-4d41-b839-13ffdf25feaa tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:54.589236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-264716f7-cc2f-4fe8-8120-b9cbe7187c73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:54.589846 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-264716f7-cc2f-4fe8-8120-b9cbe7187c73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:54.596294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-264716f7-cc2f-4fe8-8120-b9cbe7187c73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:54.596776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-264716f7-cc2f-4fe8-8120-b9cbe7187c73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:54.597209 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-264716f7-cc2f-4fe8-8120-b9cbe7187c73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:54.597894 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-264716f7-cc2f-4fe8-8120-b9cbe7187c73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:54.598357 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-264716f7-cc2f-4fe8-8120-b9cbe7187c73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:54.599294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-264716f7-cc2f-4fe8-8120-b9cbe7187c73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:54.627253 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:37:54.656995 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b784343e-f418-4d41-b839-13ffdf25feaa tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:54.669949 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b784343e-f418-4d41-b839-13ffdf25feaa tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1191 microversion: 2.1 time: 0.095373 Sep 03 01:37:54.670866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 380/735] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:54 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1191 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:54.746049 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-264716f7-cc2f-4fe8-8120-b9cbe7187c73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:54.753789 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-264716f7-cc2f-4fe8-8120-b9cbe7187c73 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1365 microversion: 2.1 time: 0.168334 Sep 03 01:37:54.754551 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 356/736] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:54 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:55.693601 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-4db1e2e5-2b5d-415d-9a90-d356e729b21d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:55.694495 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-4db1e2e5-2b5d-415d-9a90-d356e729b21d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:55.700928 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4db1e2e5-2b5d-415d-9a90-d356e729b21d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:55.701935 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4db1e2e5-2b5d-415d-9a90-d356e729b21d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:55.702495 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4db1e2e5-2b5d-415d-9a90-d356e729b21d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:55.703290 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4db1e2e5-2b5d-415d-9a90-d356e729b21d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:55.704331 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4db1e2e5-2b5d-415d-9a90-d356e729b21d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:55.704624 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4db1e2e5-2b5d-415d-9a90-d356e729b21d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:55.720199 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-a4041fdd-f281-4b49-ad44-a359e7d6d658 req-640d6121-4ef3-4197-8b28-fe7973d8c10e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb78ff3-5840-45d5-8185-450243588142", "name": "network-vif-plugged", "status": "completed", "tag": "d45b0a37-c43a-46e4-8121-1008ccf616f3"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:55.736322 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-a4041fdd-f281-4b49-ad44-a359e7d6d658 req-640d6121-4ef3-4197-8b28-fe7973d8c10e service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:55.740027 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-a4041fdd-f281-4b49-ad44-a359e7d6d658 req-640d6121-4ef3-4197-8b28-fe7973d8c10e service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:55.740027 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-a4041fdd-f281-4b49-ad44-a359e7d6d658 req-640d6121-4ef3-4197-8b28-fe7973d8c10e service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:55.751022 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-a4041fdd-f281-4b49-ad44-a359e7d6d658 req-640d6121-4ef3-4197-8b28-fe7973d8c10e service nova] Creating event network-vif-plugged:d45b0a37-c43a-46e4-8121-1008ccf616f3 for instance 3fb78ff3-5840-45d5-8185-450243588142 on hv-cinder-83800 Sep 03 01:37:55.757459 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-a4041fdd-f281-4b49-ad44-a359e7d6d658 req-640d6121-4ef3-4197-8b28-fe7973d8c10e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045186 Sep 03 01:37:55.758290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 357/737] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:55.778762 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ff05579a-1481-4d5c-9f9a-d9233885a5fe tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:55.779460 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ff05579a-1481-4d5c-9f9a-d9233885a5fe tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:55.792094 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff05579a-1481-4d5c-9f9a-d9233885a5fe tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:55.792094 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff05579a-1481-4d5c-9f9a-d9233885a5fe tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:55.794520 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff05579a-1481-4d5c-9f9a-d9233885a5fe tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:55.794520 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff05579a-1481-4d5c-9f9a-d9233885a5fe tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:55.794520 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff05579a-1481-4d5c-9f9a-d9233885a5fe tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:55.794520 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff05579a-1481-4d5c-9f9a-d9233885a5fe tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:55.970200 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ff05579a-1481-4d5c-9f9a-d9233885a5fe tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:55.979809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ff05579a-1481-4d5c-9f9a-d9233885a5fe tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1365 microversion: 2.1 time: 0.206539 Sep 03 01:37:55.980559 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 358/738] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:55 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:56.031793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-4db1e2e5-2b5d-415d-9a90-d356e729b21d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:56.040766 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-4db1e2e5-2b5d-415d-9a90-d356e729b21d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1277 microversion: 2.1 time: 0.351398 Sep 03 01:37:56.041828 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 381/739] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:55 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1277 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:56.752666 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-ccd61a7c-176d-4cee-9656-18de2deb45a7 req-e2e0786d-037c-4ebc-bba8-38e5e425a4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "843467ed-5454-46d9-8626-619ff8f27fd9", "tag": "f3456acb-4580-4e62-9494-7b8fd05f264e"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:56.765745 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-ccd61a7c-176d-4cee-9656-18de2deb45a7 req-e2e0786d-037c-4ebc-bba8-38e5e425a4dc service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:56.766427 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-ccd61a7c-176d-4cee-9656-18de2deb45a7 req-e2e0786d-037c-4ebc-bba8-38e5e425a4dc service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:56.766930 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-ccd61a7c-176d-4cee-9656-18de2deb45a7 req-e2e0786d-037c-4ebc-bba8-38e5e425a4dc service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:56.780354 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-ccd61a7c-176d-4cee-9656-18de2deb45a7 req-e2e0786d-037c-4ebc-bba8-38e5e425a4dc service nova] Creating event network-changed:f3456acb-4580-4e62-9494-7b8fd05f264e for instance 843467ed-5454-46d9-8626-619ff8f27fd9 on hv-cinder-83800 Sep 03 01:37:56.787254 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-ccd61a7c-176d-4cee-9656-18de2deb45a7 req-e2e0786d-037c-4ebc-bba8-38e5e425a4dc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038974 Sep 03 01:37:56.788026 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 359/740] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:37:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:57.004246 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-03117c05-a006-4f81-af49-25973f934665 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:57.004781 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-03117c05-a006-4f81-af49-25973f934665 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:57.011872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-03117c05-a006-4f81-af49-25973f934665 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:57.012355 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-03117c05-a006-4f81-af49-25973f934665 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:57.012792 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-03117c05-a006-4f81-af49-25973f934665 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:57.013478 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-03117c05-a006-4f81-af49-25973f934665 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:57.013927 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-03117c05-a006-4f81-af49-25973f934665 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:57.014362 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-03117c05-a006-4f81-af49-25973f934665 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:57.065933 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cf39f711-5af4-4167-be8d-f0188bec6664 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:57.066806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-cf39f711-5af4-4167-be8d-f0188bec6664 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:57.075018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cf39f711-5af4-4167-be8d-f0188bec6664 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:57.075584 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cf39f711-5af4-4167-be8d-f0188bec6664 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:57.076024 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cf39f711-5af4-4167-be8d-f0188bec6664 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:57.076718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cf39f711-5af4-4167-be8d-f0188bec6664 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:57.077699 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cf39f711-5af4-4167-be8d-f0188bec6664 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:57.077699 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cf39f711-5af4-4167-be8d-f0188bec6664 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:57.147075 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-03117c05-a006-4f81-af49-25973f934665 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:57.154669 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-03117c05-a006-4f81-af49-25973f934665 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1365 microversion: 2.1 time: 0.154296 Sep 03 01:37:57.158490 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 382/741] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:56 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:57.216575 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cf39f711-5af4-4167-be8d-f0188bec6664 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:57.225307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-cf39f711-5af4-4167-be8d-f0188bec6664 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1277 microversion: 2.1 time: 0.164705 Sep 03 01:37:57.225884 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 360/742] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:57 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:58.179685 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a08ab415-d0a5-47e0-890b-9eacbac9ca62 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:58.180295 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a08ab415-d0a5-47e0-890b-9eacbac9ca62 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:58.186765 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a08ab415-d0a5-47e0-890b-9eacbac9ca62 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:58.187250 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a08ab415-d0a5-47e0-890b-9eacbac9ca62 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:58.187680 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a08ab415-d0a5-47e0-890b-9eacbac9ca62 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:58.188369 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a08ab415-d0a5-47e0-890b-9eacbac9ca62 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:58.188818 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a08ab415-d0a5-47e0-890b-9eacbac9ca62 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:58.189238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a08ab415-d0a5-47e0-890b-9eacbac9ca62 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:58.247984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6361649e-938f-436c-906e-a6d8e58974b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:58.248599 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6361649e-938f-436c-906e-a6d8e58974b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:58.255551 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6361649e-938f-436c-906e-a6d8e58974b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:58.256799 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6361649e-938f-436c-906e-a6d8e58974b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:58.257416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6361649e-938f-436c-906e-a6d8e58974b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:58.258111 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6361649e-938f-436c-906e-a6d8e58974b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:58.258587 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6361649e-938f-436c-906e-a6d8e58974b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:58.259014 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6361649e-938f-436c-906e-a6d8e58974b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:58.374856 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a08ab415-d0a5-47e0-890b-9eacbac9ca62 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:58.387656 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a08ab415-d0a5-47e0-890b-9eacbac9ca62 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1555 microversion: 2.1 time: 0.211539 Sep 03 01:37:58.389646 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 383/743] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:58 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1555 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:37:58.406690 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6361649e-938f-436c-906e-a6d8e58974b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:58.410688 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7c35bb92-2143-41da-9f6a-721ea2c386a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:58.411332 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7c35bb92-2143-41da-9f6a-721ea2c386a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:58.416481 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6361649e-938f-436c-906e-a6d8e58974b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1277 microversion: 2.1 time: 0.172532 Sep 03 01:37:58.417059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 361/744] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:58 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:37:58.417755 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7c35bb92-2143-41da-9f6a-721ea2c386a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:58.418301 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7c35bb92-2143-41da-9f6a-721ea2c386a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:58.418769 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7c35bb92-2143-41da-9f6a-721ea2c386a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:58.419475 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7c35bb92-2143-41da-9f6a-721ea2c386a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:58.419914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7c35bb92-2143-41da-9f6a-721ea2c386a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:58.420341 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7c35bb92-2143-41da-9f6a-721ea2c386a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:58.505633 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7c35bb92-2143-41da-9f6a-721ea2c386a5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099061 Sep 03 01:37:58.506173 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 384/745] 10.222.0.13 () {58 vars in 1275 bytes} [Sat Sep 3 01:37:58 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-interface => generated 285 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:37:59.439548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9089972b-b510-458c-b936-67f419000c77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:37:59.440167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9089972b-b510-458c-b936-67f419000c77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:37:59.446601 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9089972b-b510-458c-b936-67f419000c77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:59.447086 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9089972b-b510-458c-b936-67f419000c77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:59.447523 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9089972b-b510-458c-b936-67f419000c77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:59.448208 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9089972b-b510-458c-b936-67f419000c77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:59.448661 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9089972b-b510-458c-b936-67f419000c77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:59.449084 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9089972b-b510-458c-b936-67f419000c77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:59.581902 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-517d9d78-7d7f-40aa-9a63-d56840211925 req-622b0915-8fb5-45c6-b42c-4b33c2585ada service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fb78ff3-5840-45d5-8185-450243588142", "tag": "d45b0a37-c43a-46e4-8121-1008ccf616f3"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:37:59.593905 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-517d9d78-7d7f-40aa-9a63-d56840211925 req-622b0915-8fb5-45c6-b42c-4b33c2585ada service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:37:59.594515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-517d9d78-7d7f-40aa-9a63-d56840211925 req-622b0915-8fb5-45c6-b42c-4b33c2585ada service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:37:59.595013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-517d9d78-7d7f-40aa-9a63-d56840211925 req-622b0915-8fb5-45c6-b42c-4b33c2585ada service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:37:59.607336 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-517d9d78-7d7f-40aa-9a63-d56840211925 req-622b0915-8fb5-45c6-b42c-4b33c2585ada service nova] Creating event network-changed:d45b0a37-c43a-46e4-8121-1008ccf616f3 for instance 3fb78ff3-5840-45d5-8185-450243588142 on hv-cinder-83800 Sep 03 01:37:59.612783 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-517d9d78-7d7f-40aa-9a63-d56840211925 req-622b0915-8fb5-45c6-b42c-4b33c2585ada service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034345 Sep 03 01:37:59.613898 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 385/746] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:37:59.635756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9089972b-b510-458c-b936-67f419000c77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:37:59.643516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9089972b-b510-458c-b936-67f419000c77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1277 microversion: 2.1 time: 0.207805 Sep 03 01:37:59.644017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 362/747] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:37:59 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1277 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:00.671086 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-00c3e877-2db2-405f-9277-99a87cb77421 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:00.671997 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-00c3e877-2db2-405f-9277-99a87cb77421 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:00.681490 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:00.683806 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00c3e877-2db2-405f-9277-99a87cb77421 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:00.684680 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00c3e877-2db2-405f-9277-99a87cb77421 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:00.685393 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00c3e877-2db2-405f-9277-99a87cb77421 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:00.686527 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00c3e877-2db2-405f-9277-99a87cb77421 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:00.687242 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00c3e877-2db2-405f-9277-99a87cb77421 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:00.687931 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-00c3e877-2db2-405f-9277-99a87cb77421 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:00.899818 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-00c3e877-2db2-405f-9277-99a87cb77421 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:00.908505 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-00c3e877-2db2-405f-9277-99a87cb77421 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1277 microversion: 2.1 time: 0.247197 Sep 03 01:38:00.909108 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 386/748] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:00 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1277 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:01.933014 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cda5f20b-5bf8-4b64-87f5-c8be5c073b7b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:01.933584 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-cda5f20b-5bf8-4b64-87f5-c8be5c073b7b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:01.935961 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=4 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:01.940735 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cda5f20b-5bf8-4b64-87f5-c8be5c073b7b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:01.941212 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cda5f20b-5bf8-4b64-87f5-c8be5c073b7b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:01.941644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cda5f20b-5bf8-4b64-87f5-c8be5c073b7b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:01.942322 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cda5f20b-5bf8-4b64-87f5-c8be5c073b7b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:01.942794 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cda5f20b-5bf8-4b64-87f5-c8be5c073b7b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:01.943841 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cda5f20b-5bf8-4b64-87f5-c8be5c073b7b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:02.076567 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cda5f20b-5bf8-4b64-87f5-c8be5c073b7b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:02.084894 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-cda5f20b-5bf8-4b64-87f5-c8be5c073b7b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.155186 Sep 03 01:38:02.085470 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 363/749] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:01 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:03.106653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2cc00cc0-9c4f-45d1-8079-26c8cad407b4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:03.107270 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2cc00cc0-9c4f-45d1-8079-26c8cad407b4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:03.113617 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2cc00cc0-9c4f-45d1-8079-26c8cad407b4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:03.114103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2cc00cc0-9c4f-45d1-8079-26c8cad407b4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:03.114578 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2cc00cc0-9c4f-45d1-8079-26c8cad407b4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:03.115913 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2cc00cc0-9c4f-45d1-8079-26c8cad407b4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:03.116601 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2cc00cc0-9c4f-45d1-8079-26c8cad407b4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:03.117066 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2cc00cc0-9c4f-45d1-8079-26c8cad407b4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:03.250736 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2cc00cc0-9c4f-45d1-8079-26c8cad407b4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:03.259391 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2cc00cc0-9c4f-45d1-8079-26c8cad407b4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.156532 Sep 03 01:38:03.259967 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 387/750] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:03 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:04.281242 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2604d957-b85d-44b5-bbe6-a53613b3b19d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:04.281847 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2604d957-b85d-44b5-bbe6-a53613b3b19d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:04.283983 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=14 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:04.289779 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2604d957-b85d-44b5-bbe6-a53613b3b19d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:04.290262 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2604d957-b85d-44b5-bbe6-a53613b3b19d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:04.290725 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2604d957-b85d-44b5-bbe6-a53613b3b19d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:04.291419 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2604d957-b85d-44b5-bbe6-a53613b3b19d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:04.291871 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2604d957-b85d-44b5-bbe6-a53613b3b19d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:04.292294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2604d957-b85d-44b5-bbe6-a53613b3b19d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:04.421940 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2604d957-b85d-44b5-bbe6-a53613b3b19d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:04.429863 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2604d957-b85d-44b5-bbe6-a53613b3b19d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.152433 Sep 03 01:38:04.430450 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 364/751] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:04 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:05.453043 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cbb839d5-ce3c-4152-b444-cb15901a4645 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:05.453642 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cbb839d5-ce3c-4152-b444-cb15901a4645 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:05.460736 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cbb839d5-ce3c-4152-b444-cb15901a4645 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:05.461257 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cbb839d5-ce3c-4152-b444-cb15901a4645 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:05.461686 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cbb839d5-ce3c-4152-b444-cb15901a4645 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:05.462387 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cbb839d5-ce3c-4152-b444-cb15901a4645 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:05.462837 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cbb839d5-ce3c-4152-b444-cb15901a4645 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:05.463256 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cbb839d5-ce3c-4152-b444-cb15901a4645 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:05.842816 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cbb839d5-ce3c-4152-b444-cb15901a4645 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:05.850694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cbb839d5-ce3c-4152-b444-cb15901a4645 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.401615 Sep 03 01:38:05.851267 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 388/752] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:05 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:06.873029 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5c803da5-949f-43ed-84b7-c53ccae833f9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:06.873641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5c803da5-949f-43ed-84b7-c53ccae833f9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:06.879679 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5c803da5-949f-43ed-84b7-c53ccae833f9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:06.880166 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5c803da5-949f-43ed-84b7-c53ccae833f9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:06.880689 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5c803da5-949f-43ed-84b7-c53ccae833f9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:06.881394 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5c803da5-949f-43ed-84b7-c53ccae833f9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:06.881849 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5c803da5-949f-43ed-84b7-c53ccae833f9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:06.882278 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5c803da5-949f-43ed-84b7-c53ccae833f9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:07.014677 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5c803da5-949f-43ed-84b7-c53ccae833f9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:07.022993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5c803da5-949f-43ed-84b7-c53ccae833f9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.153977 Sep 03 01:38:07.023561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 365/753] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:06 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:08.047136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-902c9c56-f002-4f10-9d85-9c893e2c2e92 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:08.047735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-902c9c56-f002-4f10-9d85-9c893e2c2e92 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:08.054842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-902c9c56-f002-4f10-9d85-9c893e2c2e92 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:08.055319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-902c9c56-f002-4f10-9d85-9c893e2c2e92 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:08.055750 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-902c9c56-f002-4f10-9d85-9c893e2c2e92 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:08.056432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-902c9c56-f002-4f10-9d85-9c893e2c2e92 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:08.056906 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-902c9c56-f002-4f10-9d85-9c893e2c2e92 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:08.057326 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-902c9c56-f002-4f10-9d85-9c893e2c2e92 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:08.185145 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-902c9c56-f002-4f10-9d85-9c893e2c2e92 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:08.188583 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:08.193084 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-902c9c56-f002-4f10-9d85-9c893e2c2e92 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.150124 Sep 03 01:38:08.193689 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 389/754] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:08 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:09.188975 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5cbefc22-1ada-420b-93d0-949c885e7061 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:09.189600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5cbefc22-1ada-420b-93d0-949c885e7061 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:09.195678 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5cbefc22-1ada-420b-93d0-949c885e7061 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:09.199497 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5cbefc22-1ada-420b-93d0-949c885e7061 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:09.199497 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5cbefc22-1ada-420b-93d0-949c885e7061 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:09.199497 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5cbefc22-1ada-420b-93d0-949c885e7061 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:09.199497 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5cbefc22-1ada-420b-93d0-949c885e7061 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:09.199884 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5cbefc22-1ada-420b-93d0-949c885e7061 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:09.201870 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=100 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:09.216118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-047b6d65-0010-43f2-a6ce-277a227d9181 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:09.216766 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-047b6d65-0010-43f2-a6ce-277a227d9181 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:09.226189 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-047b6d65-0010-43f2-a6ce-277a227d9181 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:09.226690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-047b6d65-0010-43f2-a6ce-277a227d9181 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:09.227153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-047b6d65-0010-43f2-a6ce-277a227d9181 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:09.227851 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-047b6d65-0010-43f2-a6ce-277a227d9181 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:09.228303 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-047b6d65-0010-43f2-a6ce-277a227d9181 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:09.228821 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-047b6d65-0010-43f2-a6ce-277a227d9181 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:09.281320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-5cbefc22-1ada-420b-93d0-949c885e7061 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lazy-loading 'services' on Instance uuid 34abe46a-5361-4e96-a952-5909fad8c4f4 {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:38:09.364360 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-047b6d65-0010-43f2-a6ce-277a227d9181 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:09.372700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-047b6d65-0010-43f2-a6ce-277a227d9181 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.160633 Sep 03 01:38:09.373259 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 390/755] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:09 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:09.512306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5cbefc22-1ada-420b-93d0-949c885e7061 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments/cd3cadc2-09f0-44f4-a795-81470d7fe18c" status: 202 len: 0 microversion: 2.1 time: 0.327021 Sep 03 01:38:09.512901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 366/756] 10.222.0.13 () {58 vars in 1416 bytes} [Sat Sep 3 01:38:09 2022] DELETE /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments/cd3cadc2-09f0-44f4-a795-81470d7fe18c => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:38:09.521911 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-027b83dc-8fe2-4e3a-a1cc-4eb1434ca5a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:09.524190 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-027b83dc-8fe2-4e3a-a1cc-4eb1434ca5a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:09.530135 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-027b83dc-8fe2-4e3a-a1cc-4eb1434ca5a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:09.530653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-027b83dc-8fe2-4e3a-a1cc-4eb1434ca5a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:09.531092 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-027b83dc-8fe2-4e3a-a1cc-4eb1434ca5a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:09.531785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-027b83dc-8fe2-4e3a-a1cc-4eb1434ca5a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:09.532241 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-027b83dc-8fe2-4e3a-a1cc-4eb1434ca5a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:09.532934 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-027b83dc-8fe2-4e3a-a1cc-4eb1434ca5a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:09.562775 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-027b83dc-8fe2-4e3a-a1cc-4eb1434ca5a7 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045237 Sep 03 01:38:09.563347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 391/757] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:38:09 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:09.986325 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-052f3914-85cb-4576-9af3-5ce89b934e4f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:09.986943 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-052f3914-85cb-4576-9af3-5ce89b934e4f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:09.993273 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-052f3914-85cb-4576-9af3-5ce89b934e4f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:09.993757 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-052f3914-85cb-4576-9af3-5ce89b934e4f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:09.994197 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-052f3914-85cb-4576-9af3-5ce89b934e4f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:09.994924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-052f3914-85cb-4576-9af3-5ce89b934e4f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:09.995381 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-052f3914-85cb-4576-9af3-5ce89b934e4f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:10.000130 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-052f3914-85cb-4576-9af3-5ce89b934e4f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:10.034004 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-052f3914-85cb-4576-9af3-5ce89b934e4f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments/a0c7ba9b-87a5-4ce8-bb75-899d1942cb9a" status: 200 len: 194 microversion: 2.20 time: 0.148372 Sep 03 01:38:10.034004 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 367/758] 10.222.0.13 () {60 vars in 1454 bytes} [Sat Sep 3 01:38:09 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments/a0c7ba9b-87a5-4ce8-bb75-899d1942cb9a => generated 194 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:38:10.098471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-69c4b15e-6eef-459f-a665-0ca9e546c47a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:10.099057 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-69c4b15e-6eef-459f-a665-0ca9e546c47a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:10.105916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-69c4b15e-6eef-459f-a665-0ca9e546c47a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:10.106473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-69c4b15e-6eef-459f-a665-0ca9e546c47a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:10.106907 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-69c4b15e-6eef-459f-a665-0ca9e546c47a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:10.107603 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-69c4b15e-6eef-459f-a665-0ca9e546c47a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:10.108035 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-69c4b15e-6eef-459f-a665-0ca9e546c47a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:10.108453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-69c4b15e-6eef-459f-a665-0ca9e546c47a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:10.194083 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-69c4b15e-6eef-459f-a665-0ca9e546c47a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lazy-loading 'services' on Instance uuid 329ea656-c337-4f07-bd3d-9f67c4d6418e {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:38:10.396525 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-fb4fa462-e9a7-4b09-b04d-64ec419e9909 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:10.397239 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-fb4fa462-e9a7-4b09-b04d-64ec419e9909 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:10.401924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:10.403227 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-69c4b15e-6eef-459f-a665-0ca9e546c47a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "DELETE /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments/a0c7ba9b-87a5-4ce8-bb75-899d1942cb9a" status: 202 len: 0 microversion: 2.20 time: 0.308730 Sep 03 01:38:10.407989 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 392/759] 10.222.0.13 () {60 vars in 1457 bytes} [Sat Sep 3 01:38:10 2022] DELETE /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments/a0c7ba9b-87a5-4ce8-bb75-899d1942cb9a => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 03 01:38:10.408105 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fb4fa462-e9a7-4b09-b04d-64ec419e9909 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:10.408206 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fb4fa462-e9a7-4b09-b04d-64ec419e9909 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:10.408642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fb4fa462-e9a7-4b09-b04d-64ec419e9909 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:10.409337 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fb4fa462-e9a7-4b09-b04d-64ec419e9909 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:10.410052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fb4fa462-e9a7-4b09-b04d-64ec419e9909 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:10.410512 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fb4fa462-e9a7-4b09-b04d-64ec419e9909 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:10.416349 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f7f3ab9c-536b-4b2e-afde-ed12fd3e6eef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:10.418769 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f7f3ab9c-536b-4b2e-afde-ed12fd3e6eef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:10.424989 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7f3ab9c-536b-4b2e-afde-ed12fd3e6eef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:10.425437 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7f3ab9c-536b-4b2e-afde-ed12fd3e6eef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:10.425872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7f3ab9c-536b-4b2e-afde-ed12fd3e6eef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:10.427119 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7f3ab9c-536b-4b2e-afde-ed12fd3e6eef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:10.427119 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7f3ab9c-536b-4b2e-afde-ed12fd3e6eef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:10.428075 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7f3ab9c-536b-4b2e-afde-ed12fd3e6eef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:10.459493 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f7f3ab9c-536b-4b2e-afde-ed12fd3e6eef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047227 Sep 03 01:38:10.460083 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 393/760] 10.222.0.13 () {60 vars in 1343 bytes} [Sat Sep 3 01:38:10 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:38:10.546201 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-fb4fa462-e9a7-4b09-b04d-64ec419e9909 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:10.554221 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-fb4fa462-e9a7-4b09-b04d-64ec419e9909 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.162466 Sep 03 01:38:10.554819 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 368/761] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:10 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:10.672394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3726d618-0e0d-4c2c-b9b1-b95fc7fe1364 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:10.674592 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-3726d618-0e0d-4c2c-b9b1-b95fc7fe1364 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:10.681106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3726d618-0e0d-4c2c-b9b1-b95fc7fe1364 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:10.681595 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3726d618-0e0d-4c2c-b9b1-b95fc7fe1364 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:10.682035 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3726d618-0e0d-4c2c-b9b1-b95fc7fe1364 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:10.682753 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3726d618-0e0d-4c2c-b9b1-b95fc7fe1364 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:10.683216 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3726d618-0e0d-4c2c-b9b1-b95fc7fe1364 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:10.683646 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3726d618-0e0d-4c2c-b9b1-b95fc7fe1364 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:10.719379 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3726d618-0e0d-4c2c-b9b1-b95fc7fe1364 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.148059 Sep 03 01:38:10.719966 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 394/762] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:38:10 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:11.472624 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-79a6e974-4baf-42fa-a862-6690d1e080b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:11.474925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-79a6e974-4baf-42fa-a862-6690d1e080b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:11.481258 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-79a6e974-4baf-42fa-a862-6690d1e080b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:11.481732 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-79a6e974-4baf-42fa-a862-6690d1e080b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:11.482158 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-79a6e974-4baf-42fa-a862-6690d1e080b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:11.482857 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-79a6e974-4baf-42fa-a862-6690d1e080b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:11.483304 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-79a6e974-4baf-42fa-a862-6690d1e080b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:11.483720 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-79a6e974-4baf-42fa-a862-6690d1e080b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:11.512778 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-79a6e974-4baf-42fa-a862-6690d1e080b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044219 Sep 03 01:38:11.513316 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 369/763] 10.222.0.13 () {60 vars in 1343 bytes} [Sat Sep 3 01:38:11 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 01:38:11.576649 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f7daf4b8-3f33-4d46-a97a-866e4c7b4844 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:11.577258 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f7daf4b8-3f33-4d46-a97a-866e4c7b4844 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:11.584157 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7daf4b8-3f33-4d46-a97a-866e4c7b4844 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:11.584638 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7daf4b8-3f33-4d46-a97a-866e4c7b4844 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:11.585073 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7daf4b8-3f33-4d46-a97a-866e4c7b4844 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:11.585754 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7daf4b8-3f33-4d46-a97a-866e4c7b4844 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:11.586207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7daf4b8-3f33-4d46-a97a-866e4c7b4844 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:11.586667 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7daf4b8-3f33-4d46-a97a-866e4c7b4844 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:11.714296 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f7daf4b8-3f33-4d46-a97a-866e4c7b4844 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:11.721879 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f7daf4b8-3f33-4d46-a97a-866e4c7b4844 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.149072 Sep 03 01:38:11.722477 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 395/764] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:11 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:11.732666 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7a9e0eb8-36cb-4fb6-9865-f32c6fa6d60c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:11.734939 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7a9e0eb8-36cb-4fb6-9865-f32c6fa6d60c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:11.740897 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7a9e0eb8-36cb-4fb6-9865-f32c6fa6d60c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:11.741380 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7a9e0eb8-36cb-4fb6-9865-f32c6fa6d60c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:11.741817 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7a9e0eb8-36cb-4fb6-9865-f32c6fa6d60c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:11.742545 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7a9e0eb8-36cb-4fb6-9865-f32c6fa6d60c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:11.743032 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7a9e0eb8-36cb-4fb6-9865-f32c6fa6d60c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:11.743456 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7a9e0eb8-36cb-4fb6-9865-f32c6fa6d60c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:11.772919 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7a9e0eb8-36cb-4fb6-9865-f32c6fa6d60c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044302 Sep 03 01:38:11.773475 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 370/765] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:38:11 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:12.526241 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f7ef3158-07bd-441e-b84a-b65d56ca2ccf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:12.528501 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f7ef3158-07bd-441e-b84a-b65d56ca2ccf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:12.534781 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7ef3158-07bd-441e-b84a-b65d56ca2ccf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:12.535282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7ef3158-07bd-441e-b84a-b65d56ca2ccf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:12.535700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7ef3158-07bd-441e-b84a-b65d56ca2ccf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:12.536413 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7ef3158-07bd-441e-b84a-b65d56ca2ccf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:12.537450 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7ef3158-07bd-441e-b84a-b65d56ca2ccf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:12.537989 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f7ef3158-07bd-441e-b84a-b65d56ca2ccf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:12.566908 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f7ef3158-07bd-441e-b84a-b65d56ca2ccf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044881 Sep 03 01:38:12.567465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 396/766] 10.222.0.13 () {60 vars in 1343 bytes} [Sat Sep 3 01:38:12 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:38:12.744855 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-495e8e59-a501-410e-960c-db5f0510419f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:12.745375 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-495e8e59-a501-410e-960c-db5f0510419f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:12.752095 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-495e8e59-a501-410e-960c-db5f0510419f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:12.752678 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-495e8e59-a501-410e-960c-db5f0510419f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:12.753117 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-495e8e59-a501-410e-960c-db5f0510419f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:12.753802 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-495e8e59-a501-410e-960c-db5f0510419f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:12.754328 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-495e8e59-a501-410e-960c-db5f0510419f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:12.754781 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-495e8e59-a501-410e-960c-db5f0510419f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:12.785519 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-78c9b64e-b42d-4d2a-ba2d-e9c14914ace1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:12.788757 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-78c9b64e-b42d-4d2a-ba2d-e9c14914ace1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:12.794467 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-78c9b64e-b42d-4d2a-ba2d-e9c14914ace1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:12.795037 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-78c9b64e-b42d-4d2a-ba2d-e9c14914ace1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:12.795471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-78c9b64e-b42d-4d2a-ba2d-e9c14914ace1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:12.796157 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-78c9b64e-b42d-4d2a-ba2d-e9c14914ace1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:12.796605 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-78c9b64e-b42d-4d2a-ba2d-e9c14914ace1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:12.797023 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-78c9b64e-b42d-4d2a-ba2d-e9c14914ace1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:12.829842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-78c9b64e-b42d-4d2a-ba2d-e9c14914ace1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048494 Sep 03 01:38:12.832696 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 397/767] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:38:12 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:38:12.890044 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-495e8e59-a501-410e-960c-db5f0510419f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:12.898947 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-495e8e59-a501-410e-960c-db5f0510419f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.158022 Sep 03 01:38:12.899512 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 371/768] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:12 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:13.580054 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6f015f17-426e-4aca-89fb-49abdf998faf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:13.582208 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6f015f17-426e-4aca-89fb-49abdf998faf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:13.589045 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f015f17-426e-4aca-89fb-49abdf998faf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:13.589518 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f015f17-426e-4aca-89fb-49abdf998faf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:13.589946 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f015f17-426e-4aca-89fb-49abdf998faf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:13.590664 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f015f17-426e-4aca-89fb-49abdf998faf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:13.591114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f015f17-426e-4aca-89fb-49abdf998faf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:13.591532 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6f015f17-426e-4aca-89fb-49abdf998faf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:13.623247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6f015f17-426e-4aca-89fb-49abdf998faf tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047127 Sep 03 01:38:13.623874 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 398/769] 10.222.0.13 () {60 vars in 1343 bytes} [Sat Sep 3 01:38:13 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:38:13.843492 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-758ad41d-effd-4ae0-aaa7-0fecd1dacb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:13.845584 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-758ad41d-effd-4ae0-aaa7-0fecd1dacb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:13.854613 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-758ad41d-effd-4ae0-aaa7-0fecd1dacb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:13.857659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-758ad41d-effd-4ae0-aaa7-0fecd1dacb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:13.857659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-758ad41d-effd-4ae0-aaa7-0fecd1dacb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:13.857659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-758ad41d-effd-4ae0-aaa7-0fecd1dacb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:13.857659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-758ad41d-effd-4ae0-aaa7-0fecd1dacb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:13.858028 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-758ad41d-effd-4ae0-aaa7-0fecd1dacb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:13.886911 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-758ad41d-effd-4ae0-aaa7-0fecd1dacb21 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047505 Sep 03 01:38:13.887482 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 372/770] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:38:13 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:13.921076 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-dd91b324-526d-4fbb-8816-d4158a1fa15b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:13.921870 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-dd91b324-526d-4fbb-8816-d4158a1fa15b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:13.928043 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd91b324-526d-4fbb-8816-d4158a1fa15b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:13.930890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd91b324-526d-4fbb-8816-d4158a1fa15b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:13.930890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd91b324-526d-4fbb-8816-d4158a1fa15b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:13.930890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd91b324-526d-4fbb-8816-d4158a1fa15b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:13.930890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd91b324-526d-4fbb-8816-d4158a1fa15b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:13.931258 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd91b324-526d-4fbb-8816-d4158a1fa15b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:14.065202 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dd91b324-526d-4fbb-8816-d4158a1fa15b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:14.074079 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-dd91b324-526d-4fbb-8816-d4158a1fa15b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.156940 Sep 03 01:38:14.074763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 399/771] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:13 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:14.635900 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bce15db8-c51d-4a9c-8ccc-16092b8473e3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:14.638120 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bce15db8-c51d-4a9c-8ccc-16092b8473e3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:14.644123 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bce15db8-c51d-4a9c-8ccc-16092b8473e3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:14.644599 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bce15db8-c51d-4a9c-8ccc-16092b8473e3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:14.645028 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bce15db8-c51d-4a9c-8ccc-16092b8473e3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:14.645708 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bce15db8-c51d-4a9c-8ccc-16092b8473e3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:14.646983 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bce15db8-c51d-4a9c-8ccc-16092b8473e3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:14.647359 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bce15db8-c51d-4a9c-8ccc-16092b8473e3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:14.677775 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bce15db8-c51d-4a9c-8ccc-16092b8473e3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045823 Sep 03 01:38:14.678327 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 373/772] 10.222.0.13 () {60 vars in 1343 bytes} [Sat Sep 3 01:38:14 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:38:14.899627 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-39e90907-b7ce-4e89-a8a3-e1aeb82418da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:14.901740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-39e90907-b7ce-4e89-a8a3-e1aeb82418da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:14.907933 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39e90907-b7ce-4e89-a8a3-e1aeb82418da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:14.908666 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39e90907-b7ce-4e89-a8a3-e1aeb82418da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:14.921622 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39e90907-b7ce-4e89-a8a3-e1aeb82418da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:14.921622 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39e90907-b7ce-4e89-a8a3-e1aeb82418da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:14.921622 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39e90907-b7ce-4e89-a8a3-e1aeb82418da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:14.921622 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39e90907-b7ce-4e89-a8a3-e1aeb82418da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:14.941695 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-39e90907-b7ce-4e89-a8a3-e1aeb82418da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046176 Sep 03 01:38:14.942261 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 400/773] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:38:14 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 01:38:15.029323 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f958d543-d700-45fe-826f-d40ae80c5d98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:15.029920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f958d543-d700-45fe-826f-d40ae80c5d98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:15.036717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f958d543-d700-45fe-826f-d40ae80c5d98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:15.037382 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f958d543-d700-45fe-826f-d40ae80c5d98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:15.037816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f958d543-d700-45fe-826f-d40ae80c5d98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:15.038532 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f958d543-d700-45fe-826f-d40ae80c5d98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:15.038987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f958d543-d700-45fe-826f-d40ae80c5d98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:15.039404 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f958d543-d700-45fe-826f-d40ae80c5d98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:15.088728 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f958d543-d700-45fe-826f-d40ae80c5d98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:38:15.098052 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0ad422db-4e40-4b5c-8e26-5165584ee7be tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:15.098708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0ad422db-4e40-4b5c-8e26-5165584ee7be tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:15.105918 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ad422db-4e40-4b5c-8e26-5165584ee7be tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:15.106431 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ad422db-4e40-4b5c-8e26-5165584ee7be tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:15.106867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ad422db-4e40-4b5c-8e26-5165584ee7be tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:15.107554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ad422db-4e40-4b5c-8e26-5165584ee7be tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:15.108000 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ad422db-4e40-4b5c-8e26-5165584ee7be tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:15.108414 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0ad422db-4e40-4b5c-8e26-5165584ee7be tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:15.293444 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0ad422db-4e40-4b5c-8e26-5165584ee7be tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:15.301074 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0ad422db-4e40-4b5c-8e26-5165584ee7be tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.207648 Sep 03 01:38:15.301669 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 401/774] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:15 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:15.410456 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f958d543-d700-45fe-826f-d40ae80c5d98 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 204 len: 0 microversion: 2.1 time: 0.384719 Sep 03 01:38:15.411299 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 374/775] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:38:15 2022] DELETE /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:38:15.419327 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-217ac3cf-3346-4dcc-9e3c-13eb26d43bcc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:15.419953 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-217ac3cf-3346-4dcc-9e3c-13eb26d43bcc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:15.425867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-217ac3cf-3346-4dcc-9e3c-13eb26d43bcc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:15.426371 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-217ac3cf-3346-4dcc-9e3c-13eb26d43bcc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:15.426823 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-217ac3cf-3346-4dcc-9e3c-13eb26d43bcc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:15.428027 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-217ac3cf-3346-4dcc-9e3c-13eb26d43bcc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:15.428488 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-217ac3cf-3346-4dcc-9e3c-13eb26d43bcc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:15.428917 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-217ac3cf-3346-4dcc-9e3c-13eb26d43bcc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:15.560500 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-217ac3cf-3346-4dcc-9e3c-13eb26d43bcc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:15.568934 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-217ac3cf-3346-4dcc-9e3c-13eb26d43bcc tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1689 microversion: 2.1 time: 0.153366 Sep 03 01:38:15.569495 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 402/776] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:15 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1689 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:15.691086 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-13092c6b-62d3-4294-b9c9-0af83a4408b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:15.693906 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-13092c6b-62d3-4294-b9c9-0af83a4408b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:15.699821 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-13092c6b-62d3-4294-b9c9-0af83a4408b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:15.700307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-13092c6b-62d3-4294-b9c9-0af83a4408b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:15.700745 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-13092c6b-62d3-4294-b9c9-0af83a4408b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:15.701435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-13092c6b-62d3-4294-b9c9-0af83a4408b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:15.701888 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-13092c6b-62d3-4294-b9c9-0af83a4408b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:15.702313 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-13092c6b-62d3-4294-b9c9-0af83a4408b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:15.732014 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-13092c6b-62d3-4294-b9c9-0af83a4408b5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045398 Sep 03 01:38:15.736840 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 375/777] 10.222.0.13 () {60 vars in 1343 bytes} [Sat Sep 3 01:38:15 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:38:15.965566 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-d18f9a00-1f5a-4e3a-87a4-2f61d7ee0e04 req-68ac3b03-f5db-4e5c-b635-e7d1e9664c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843467ed-5454-46d9-8626-619ff8f27fd9", "name": "network-vif-plugged", "status": "completed", "tag": "f3456acb-4580-4e62-9494-7b8fd05f264e"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:15.976228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-d18f9a00-1f5a-4e3a-87a4-2f61d7ee0e04 req-68ac3b03-f5db-4e5c-b635-e7d1e9664c74 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:15.976708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-d18f9a00-1f5a-4e3a-87a4-2f61d7ee0e04 req-68ac3b03-f5db-4e5c-b635-e7d1e9664c74 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:15.977136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-d18f9a00-1f5a-4e3a-87a4-2f61d7ee0e04 req-68ac3b03-f5db-4e5c-b635-e7d1e9664c74 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:15.988106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-d18f9a00-1f5a-4e3a-87a4-2f61d7ee0e04 req-68ac3b03-f5db-4e5c-b635-e7d1e9664c74 service nova] Creating event network-vif-plugged:f3456acb-4580-4e62-9494-7b8fd05f264e for instance 843467ed-5454-46d9-8626-619ff8f27fd9 on hv-cinder-83800 Sep 03 01:38:15.992954 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-d18f9a00-1f5a-4e3a-87a4-2f61d7ee0e04 req-68ac3b03-f5db-4e5c-b635-e7d1e9664c74 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031163 Sep 03 01:38:15.993530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 403/778] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:16.325048 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1d2f4cf9-ed77-4e6e-9914-bb9d8fc0d834 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:16.325667 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1d2f4cf9-ed77-4e6e-9914-bb9d8fc0d834 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:16.332164 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d2f4cf9-ed77-4e6e-9914-bb9d8fc0d834 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:16.332643 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d2f4cf9-ed77-4e6e-9914-bb9d8fc0d834 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:16.333081 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d2f4cf9-ed77-4e6e-9914-bb9d8fc0d834 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:16.333791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d2f4cf9-ed77-4e6e-9914-bb9d8fc0d834 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:16.334247 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d2f4cf9-ed77-4e6e-9914-bb9d8fc0d834 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:16.334710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1d2f4cf9-ed77-4e6e-9914-bb9d8fc0d834 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:16.465107 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1d2f4cf9-ed77-4e6e-9914-bb9d8fc0d834 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:16.472699 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1d2f4cf9-ed77-4e6e-9914-bb9d8fc0d834 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.151578 Sep 03 01:38:16.473252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 376/779] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:16 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:16.592099 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b4f2e2e1-7cf8-4993-af38-68fbdb05b45f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:16.592788 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b4f2e2e1-7cf8-4993-af38-68fbdb05b45f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:16.598741 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b4f2e2e1-7cf8-4993-af38-68fbdb05b45f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:16.599255 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b4f2e2e1-7cf8-4993-af38-68fbdb05b45f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:16.599683 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b4f2e2e1-7cf8-4993-af38-68fbdb05b45f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:16.600359 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b4f2e2e1-7cf8-4993-af38-68fbdb05b45f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:16.600804 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b4f2e2e1-7cf8-4993-af38-68fbdb05b45f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:16.601224 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b4f2e2e1-7cf8-4993-af38-68fbdb05b45f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:16.734553 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b4f2e2e1-7cf8-4993-af38-68fbdb05b45f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:16.742856 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b4f2e2e1-7cf8-4993-af38-68fbdb05b45f tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1689 microversion: 2.1 time: 0.154849 Sep 03 01:38:16.743426 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 404/780] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:16 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:16.745851 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-3cd546db-4e50-4977-a17c-916854810aec tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:16.748003 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-3cd546db-4e50-4977-a17c-916854810aec tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:16.753895 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3cd546db-4e50-4977-a17c-916854810aec tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:16.754407 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3cd546db-4e50-4977-a17c-916854810aec tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:16.754848 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3cd546db-4e50-4977-a17c-916854810aec tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:16.756365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3cd546db-4e50-4977-a17c-916854810aec tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:16.756914 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3cd546db-4e50-4977-a17c-916854810aec tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:16.757348 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3cd546db-4e50-4977-a17c-916854810aec tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:16.791119 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-3cd546db-4e50-4977-a17c-916854810aec tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049434 Sep 03 01:38:16.791698 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 377/781] 10.222.0.13 () {60 vars in 1343 bytes} [Sat Sep 3 01:38:16 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:38:17.495740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5568193a-cde8-4d74-ba69-f2fe0f8f5c74 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:17.496349 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5568193a-cde8-4d74-ba69-f2fe0f8f5c74 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:17.502737 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5568193a-cde8-4d74-ba69-f2fe0f8f5c74 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:17.503215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5568193a-cde8-4d74-ba69-f2fe0f8f5c74 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:17.503645 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5568193a-cde8-4d74-ba69-f2fe0f8f5c74 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:17.504319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5568193a-cde8-4d74-ba69-f2fe0f8f5c74 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:17.504772 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5568193a-cde8-4d74-ba69-f2fe0f8f5c74 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:17.505218 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5568193a-cde8-4d74-ba69-f2fe0f8f5c74 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:17.631802 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5568193a-cde8-4d74-ba69-f2fe0f8f5c74 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:17.639554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5568193a-cde8-4d74-ba69-f2fe0f8f5c74 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.147668 Sep 03 01:38:17.640137 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 405/782] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:17 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:17.751408 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bf7f9ee6-1835-46b7-8ef3-2c0ba5b13709 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:17.751910 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bf7f9ee6-1835-46b7-8ef3-2c0ba5b13709 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:17.758309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bf7f9ee6-1835-46b7-8ef3-2c0ba5b13709 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:17.758826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bf7f9ee6-1835-46b7-8ef3-2c0ba5b13709 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:17.759259 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bf7f9ee6-1835-46b7-8ef3-2c0ba5b13709 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:17.759943 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bf7f9ee6-1835-46b7-8ef3-2c0ba5b13709 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:17.760393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bf7f9ee6-1835-46b7-8ef3-2c0ba5b13709 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:17.760817 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bf7f9ee6-1835-46b7-8ef3-2c0ba5b13709 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:17.765834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d4475b31-2336-4c39-9f59-79bcf9e0b8da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:17.766487 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d4475b31-2336-4c39-9f59-79bcf9e0b8da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:17.772860 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d4475b31-2336-4c39-9f59-79bcf9e0b8da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:17.773347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d4475b31-2336-4c39-9f59-79bcf9e0b8da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:17.773784 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d4475b31-2336-4c39-9f59-79bcf9e0b8da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:17.774514 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d4475b31-2336-4c39-9f59-79bcf9e0b8da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:17.774987 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d4475b31-2336-4c39-9f59-79bcf9e0b8da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:17.775394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d4475b31-2336-4c39-9f59-79bcf9e0b8da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:17.795916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:17.848422 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-bf7f9ee6-1835-46b7-8ef3-2c0ba5b13709 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lazy-loading 'services' on Instance uuid 51ed6fe4-9955-4b04-b20d-b2f60e944310 {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:38:17.914150 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d4475b31-2336-4c39-9f59-79bcf9e0b8da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:17.921963 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d4475b31-2336-4c39-9f59-79bcf9e0b8da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1689 microversion: 2.1 time: 0.159974 Sep 03 01:38:17.922571 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 406/783] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:17 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:17.927293 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6fec9d5e-c9ac-4459-b91e-f722ea55ca3e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:17.929490 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6fec9d5e-c9ac-4459-b91e-f722ea55ca3e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:17.935820 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6fec9d5e-c9ac-4459-b91e-f722ea55ca3e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:17.936301 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6fec9d5e-c9ac-4459-b91e-f722ea55ca3e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:17.936740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6fec9d5e-c9ac-4459-b91e-f722ea55ca3e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:17.937426 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6fec9d5e-c9ac-4459-b91e-f722ea55ca3e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:17.937880 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6fec9d5e-c9ac-4459-b91e-f722ea55ca3e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:17.938304 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6fec9d5e-c9ac-4459-b91e-f722ea55ca3e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:17.970239 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6fec9d5e-c9ac-4459-b91e-f722ea55ca3e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046650 Sep 03 01:38:17.970834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 407/784] 10.222.0.13 () {60 vars in 1343 bytes} [Sat Sep 3 01:38:17 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:38:18.106366 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bf7f9ee6-1835-46b7-8ef3-2c0ba5b13709 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310/os-volume_attachments/61aa0d77-7c26-4289-8b30-28dde25da91f" status: 202 len: 0 microversion: 2.1 time: 0.358565 Sep 03 01:38:18.106910 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 378/785] 10.222.0.13 () {58 vars in 1416 bytes} [Sat Sep 3 01:38:17 2022] DELETE /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310/os-volume_attachments/61aa0d77-7c26-4289-8b30-28dde25da91f => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:38:18.662825 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c91ea3df-5652-4851-9dab-4df86a667e2d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:18.663468 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c91ea3df-5652-4851-9dab-4df86a667e2d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:18.669837 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c91ea3df-5652-4851-9dab-4df86a667e2d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:18.670313 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c91ea3df-5652-4851-9dab-4df86a667e2d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:18.670909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c91ea3df-5652-4851-9dab-4df86a667e2d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:18.671593 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c91ea3df-5652-4851-9dab-4df86a667e2d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:18.672038 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c91ea3df-5652-4851-9dab-4df86a667e2d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:18.672454 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c91ea3df-5652-4851-9dab-4df86a667e2d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:18.800056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c91ea3df-5652-4851-9dab-4df86a667e2d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:18.807874 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c91ea3df-5652-4851-9dab-4df86a667e2d tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.148843 Sep 03 01:38:18.808445 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 408/786] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:18 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:18.946137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-82a0e8cf-4286-4e23-aeea-bb428efee63e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:18.946862 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-82a0e8cf-4286-4e23-aeea-bb428efee63e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:18.953480 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-82a0e8cf-4286-4e23-aeea-bb428efee63e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:18.953968 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-82a0e8cf-4286-4e23-aeea-bb428efee63e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:18.954429 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-82a0e8cf-4286-4e23-aeea-bb428efee63e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:18.955122 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-82a0e8cf-4286-4e23-aeea-bb428efee63e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:18.955582 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-82a0e8cf-4286-4e23-aeea-bb428efee63e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:18.956010 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-82a0e8cf-4286-4e23-aeea-bb428efee63e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:18.982386 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f15489a1-3dfd-485e-a4a7-e2d087d0175e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:18.984525 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f15489a1-3dfd-485e-a4a7-e2d087d0175e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:18.991081 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f15489a1-3dfd-485e-a4a7-e2d087d0175e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:18.991826 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f15489a1-3dfd-485e-a4a7-e2d087d0175e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:18.994165 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f15489a1-3dfd-485e-a4a7-e2d087d0175e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:18.994165 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f15489a1-3dfd-485e-a4a7-e2d087d0175e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:18.994165 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f15489a1-3dfd-485e-a4a7-e2d087d0175e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:18.994165 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f15489a1-3dfd-485e-a4a7-e2d087d0175e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:19.026309 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f15489a1-3dfd-485e-a4a7-e2d087d0175e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047910 Sep 03 01:38:19.027239 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 409/787] 10.222.0.13 () {60 vars in 1343 bytes} [Sat Sep 3 01:38:18 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 03 01:38:19.086032 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-82a0e8cf-4286-4e23-aeea-bb428efee63e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:19.089655 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:19.094185 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-82a0e8cf-4286-4e23-aeea-bb428efee63e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1689 microversion: 2.1 time: 0.152909 Sep 03 01:38:19.094788 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 379/788] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:18 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1689 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:19.830224 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c385b853-d84a-41ee-bc37-277a7b507251 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:19.830864 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c385b853-d84a-41ee-bc37-277a7b507251 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:19.837532 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c385b853-d84a-41ee-bc37-277a7b507251 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:19.838011 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c385b853-d84a-41ee-bc37-277a7b507251 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:19.838473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c385b853-d84a-41ee-bc37-277a7b507251 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:19.839201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c385b853-d84a-41ee-bc37-277a7b507251 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:19.839656 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c385b853-d84a-41ee-bc37-277a7b507251 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:19.840078 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c385b853-d84a-41ee-bc37-277a7b507251 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:20.030773 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c385b853-d84a-41ee-bc37-277a7b507251 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:20.039498 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c385b853-d84a-41ee-bc37-277a7b507251 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.213052 Sep 03 01:38:20.040078 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 410/789] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:19 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:20.040790 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ec6f7839-ae20-423b-8466-e56efc03cb5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:20.046854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ec6f7839-ae20-423b-8466-e56efc03cb5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:20.050008 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ec6f7839-ae20-423b-8466-e56efc03cb5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:20.050525 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ec6f7839-ae20-423b-8466-e56efc03cb5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:20.050961 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ec6f7839-ae20-423b-8466-e56efc03cb5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:20.051649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ec6f7839-ae20-423b-8466-e56efc03cb5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:20.052246 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ec6f7839-ae20-423b-8466-e56efc03cb5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:20.052613 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ec6f7839-ae20-423b-8466-e56efc03cb5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:20.081390 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ec6f7839-ae20-423b-8466-e56efc03cb5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045735 Sep 03 01:38:20.081881 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 380/790] 10.222.0.13 () {60 vars in 1343 bytes} [Sat Sep 3 01:38:20 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:20.117873 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e8be1029-cfdf-4fa0-a6b5-9ab3d2a0c4da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:20.118587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e8be1029-cfdf-4fa0-a6b5-9ab3d2a0c4da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:20.124595 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e8be1029-cfdf-4fa0-a6b5-9ab3d2a0c4da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:20.125154 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e8be1029-cfdf-4fa0-a6b5-9ab3d2a0c4da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:20.125664 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e8be1029-cfdf-4fa0-a6b5-9ab3d2a0c4da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:20.126377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e8be1029-cfdf-4fa0-a6b5-9ab3d2a0c4da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:20.126946 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e8be1029-cfdf-4fa0-a6b5-9ab3d2a0c4da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:20.127450 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e8be1029-cfdf-4fa0-a6b5-9ab3d2a0c4da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:20.153450 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-65852dae-3bbd-4fdf-bd1a-32742297ede1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:20.153942 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-65852dae-3bbd-4fdf-bd1a-32742297ede1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:20.160779 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65852dae-3bbd-4fdf-bd1a-32742297ede1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:20.161288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65852dae-3bbd-4fdf-bd1a-32742297ede1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:20.161722 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65852dae-3bbd-4fdf-bd1a-32742297ede1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:20.162431 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65852dae-3bbd-4fdf-bd1a-32742297ede1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:20.162883 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65852dae-3bbd-4fdf-bd1a-32742297ede1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:20.163304 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65852dae-3bbd-4fdf-bd1a-32742297ede1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:20.188641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-65852dae-3bbd-4fdf-bd1a-32742297ede1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:38:20.277233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e8be1029-cfdf-4fa0-a6b5-9ab3d2a0c4da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:20.288150 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e8be1029-cfdf-4fa0-a6b5-9ab3d2a0c4da tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1689 microversion: 2.1 time: 0.174272 Sep 03 01:38:20.291751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 411/791] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:20 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1689 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:20.420838 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-65852dae-3bbd-4fdf-bd1a-32742297ede1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "DELETE /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 204 len: 0 microversion: 2.20 time: 0.270946 Sep 03 01:38:20.422415 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 381/792] 10.222.0.13 () {60 vars in 1280 bytes} [Sat Sep 3 01:38:20 2022] DELETE /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 03 01:38:20.431828 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a0ade953-c94d-429e-ba5c-9839eb8c1f9f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:20.432482 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a0ade953-c94d-429e-ba5c-9839eb8c1f9f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:20.438978 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0ade953-c94d-429e-ba5c-9839eb8c1f9f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:20.439715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0ade953-c94d-429e-ba5c-9839eb8c1f9f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:20.440196 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0ade953-c94d-429e-ba5c-9839eb8c1f9f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:20.440988 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0ade953-c94d-429e-ba5c-9839eb8c1f9f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:20.441588 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0ade953-c94d-429e-ba5c-9839eb8c1f9f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:20.442180 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0ade953-c94d-429e-ba5c-9839eb8c1f9f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:20.689247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a0ade953-c94d-429e-ba5c-9839eb8c1f9f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:20.698895 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a0ade953-c94d-429e-ba5c-9839eb8c1f9f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:20.700469 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a0ade953-c94d-429e-ba5c-9839eb8c1f9f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:20.701650 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a0ade953-c94d-429e-ba5c-9839eb8c1f9f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.275186 Sep 03 01:38:20.702220 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 412/793] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:20 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:21.063661 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8510c918-243f-472a-9d6d-718256b19c47 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:21.064990 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8510c918-243f-472a-9d6d-718256b19c47 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:21.071998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8510c918-243f-472a-9d6d-718256b19c47 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:21.072487 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8510c918-243f-472a-9d6d-718256b19c47 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:21.072916 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8510c918-243f-472a-9d6d-718256b19c47 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:21.073609 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8510c918-243f-472a-9d6d-718256b19c47 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:21.074384 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8510c918-243f-472a-9d6d-718256b19c47 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:21.075066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8510c918-243f-472a-9d6d-718256b19c47 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:21.200436 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-5c50e0b5-6589-475c-8fec-caaa806ee885 req-58eb689d-dd62-4144-a9ce-dc49ebbde75b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34abe46a-5361-4e96-a952-5909fad8c4f4", "name": "network-vif-deleted", "tag": "885d8df4-2f3f-463e-aa94-cb8b3ae9cb29"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:21.210849 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-5c50e0b5-6589-475c-8fec-caaa806ee885 req-58eb689d-dd62-4144-a9ce-dc49ebbde75b service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:21.211479 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-5c50e0b5-6589-475c-8fec-caaa806ee885 req-58eb689d-dd62-4144-a9ce-dc49ebbde75b service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:21.212319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-5c50e0b5-6589-475c-8fec-caaa806ee885 req-58eb689d-dd62-4144-a9ce-dc49ebbde75b service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:21.218321 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8510c918-243f-472a-9d6d-718256b19c47 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:21.227404 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8510c918-243f-472a-9d6d-718256b19c47 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.168236 Sep 03 01:38:21.228082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 382/794] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:21 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:21.231427 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-5c50e0b5-6589-475c-8fec-caaa806ee885 req-58eb689d-dd62-4144-a9ce-dc49ebbde75b service nova] Creating event network-vif-deleted:885d8df4-2f3f-463e-aa94-cb8b3ae9cb29 for instance 34abe46a-5361-4e96-a952-5909fad8c4f4 on hv-cinder-83800 Sep 03 01:38:21.236669 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-5c50e0b5-6589-475c-8fec-caaa806ee885 req-58eb689d-dd62-4144-a9ce-dc49ebbde75b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040182 Sep 03 01:38:21.237440 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 413/795] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:21.316826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2890a061-51a0-4fc4-a41b-afef4b8e62b8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:21.317893 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2890a061-51a0-4fc4-a41b-afef4b8e62b8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:21.324405 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2890a061-51a0-4fc4-a41b-afef4b8e62b8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:21.325247 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2890a061-51a0-4fc4-a41b-afef4b8e62b8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:21.325919 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2890a061-51a0-4fc4-a41b-afef4b8e62b8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:21.327024 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2890a061-51a0-4fc4-a41b-afef4b8e62b8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:21.327863 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2890a061-51a0-4fc4-a41b-afef4b8e62b8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:21.329009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2890a061-51a0-4fc4-a41b-afef4b8e62b8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:21.372449 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f1ac6446-d7c3-4ee9-b0b7-479e9dfc4879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:21.373296 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f1ac6446-d7c3-4ee9-b0b7-479e9dfc4879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:21.385660 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f1ac6446-d7c3-4ee9-b0b7-479e9dfc4879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:21.386470 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f1ac6446-d7c3-4ee9-b0b7-479e9dfc4879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:21.387088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f1ac6446-d7c3-4ee9-b0b7-479e9dfc4879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:21.387958 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f1ac6446-d7c3-4ee9-b0b7-479e9dfc4879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:21.388575 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f1ac6446-d7c3-4ee9-b0b7-479e9dfc4879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:21.389159 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f1ac6446-d7c3-4ee9-b0b7-479e9dfc4879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:21.401966 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2890a061-51a0-4fc4-a41b-afef4b8e62b8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:21.410182 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2890a061-51a0-4fc4-a41b-afef4b8e62b8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1621 microversion: 2.1 time: 0.097726 Sep 03 01:38:21.411001 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 383/796] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:21 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1621 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:21.429467 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f1ac6446-d7c3-4ee9-b0b7-479e9dfc4879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Going to try to terminate instance {{(pid=127552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:38:21.672266 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f1ac6446-d7c3-4ee9-b0b7-479e9dfc4879 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 204 len: 0 microversion: 2.1 time: 0.303599 Sep 03 01:38:21.672893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 414/797] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:38:21 2022] DELETE /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 01:38:21.681712 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-3fa86ee5-df35-4956-83e3-7765bbbf7c6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:21.682390 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-3fa86ee5-df35-4956-83e3-7765bbbf7c6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:21.688503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3fa86ee5-df35-4956-83e3-7765bbbf7c6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:21.689066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3fa86ee5-df35-4956-83e3-7765bbbf7c6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:21.689548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3fa86ee5-df35-4956-83e3-7765bbbf7c6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:21.690258 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3fa86ee5-df35-4956-83e3-7765bbbf7c6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:21.690886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3fa86ee5-df35-4956-83e3-7765bbbf7c6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:21.691311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3fa86ee5-df35-4956-83e3-7765bbbf7c6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:21.734472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9ea5abce-1759-4fcf-ba7b-b9a598ab9cb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:21.734472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9ea5abce-1759-4fcf-ba7b-b9a598ab9cb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:21.741195 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9ea5abce-1759-4fcf-ba7b-b9a598ab9cb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:21.741817 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9ea5abce-1759-4fcf-ba7b-b9a598ab9cb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:21.742262 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9ea5abce-1759-4fcf-ba7b-b9a598ab9cb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:21.742996 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9ea5abce-1759-4fcf-ba7b-b9a598ab9cb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:21.743589 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9ea5abce-1759-4fcf-ba7b-b9a598ab9cb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:21.744146 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9ea5abce-1759-4fcf-ba7b-b9a598ab9cb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:21.828916 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-3fa86ee5-df35-4956-83e3-7765bbbf7c6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:21.838150 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-3fa86ee5-df35-4956-83e3-7765bbbf7c6c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1558 microversion: 2.1 time: 0.160879 Sep 03 01:38:21.839123 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 384/798] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:21 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:21.899108 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9ea5abce-1759-4fcf-ba7b-b9a598ab9cb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:21.907366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9ea5abce-1759-4fcf-ba7b-b9a598ab9cb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:21.909269 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9ea5abce-1759-4fcf-ba7b-b9a598ab9cb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:21.910411 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9ea5abce-1759-4fcf-ba7b-b9a598ab9cb8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.181789 Sep 03 01:38:21.910973 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 415/799] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:21 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:22.250707 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c14706ce-a316-44d3-bc65-1432f573343b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:22.251323 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c14706ce-a316-44d3-bc65-1432f573343b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:22.258073 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c14706ce-a316-44d3-bc65-1432f573343b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:22.258599 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c14706ce-a316-44d3-bc65-1432f573343b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:22.259034 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c14706ce-a316-44d3-bc65-1432f573343b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:22.259719 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c14706ce-a316-44d3-bc65-1432f573343b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:22.260166 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c14706ce-a316-44d3-bc65-1432f573343b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:22.260616 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c14706ce-a316-44d3-bc65-1432f573343b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:22.396202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c14706ce-a316-44d3-bc65-1432f573343b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:22.404866 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c14706ce-a316-44d3-bc65-1432f573343b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1265 microversion: 2.1 time: 0.157986 Sep 03 01:38:22.406858 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 385/800] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:22 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:22.433324 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e53e2b1d-56c2-49b7-b15d-86f3e67a9570 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:22.437159 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e53e2b1d-56c2-49b7-b15d-86f3e67a9570 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:22.440476 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e53e2b1d-56c2-49b7-b15d-86f3e67a9570 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:22.440965 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e53e2b1d-56c2-49b7-b15d-86f3e67a9570 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:22.441398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e53e2b1d-56c2-49b7-b15d-86f3e67a9570 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:22.442077 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e53e2b1d-56c2-49b7-b15d-86f3e67a9570 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:22.442565 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e53e2b1d-56c2-49b7-b15d-86f3e67a9570 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:22.442976 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e53e2b1d-56c2-49b7-b15d-86f3e67a9570 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:22.505034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e53e2b1d-56c2-49b7-b15d-86f3e67a9570 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:22.512982 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e53e2b1d-56c2-49b7-b15d-86f3e67a9570 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1621 microversion: 2.1 time: 0.083539 Sep 03 01:38:22.513585 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 416/801] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:22 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1621 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:22.861246 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-84cc09b4-51ce-478c-9922-cff0872cc2f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:22.861851 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-84cc09b4-51ce-478c-9922-cff0872cc2f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:22.868539 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-84cc09b4-51ce-478c-9922-cff0872cc2f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:22.869015 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-84cc09b4-51ce-478c-9922-cff0872cc2f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:22.869443 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-84cc09b4-51ce-478c-9922-cff0872cc2f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:22.870243 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-84cc09b4-51ce-478c-9922-cff0872cc2f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:22.870715 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-84cc09b4-51ce-478c-9922-cff0872cc2f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:22.871133 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-84cc09b4-51ce-478c-9922-cff0872cc2f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:22.936491 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c714ddb7-f644-47c1-94aa-c7d3288a232e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:22.937240 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c714ddb7-f644-47c1-94aa-c7d3288a232e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:22.943293 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c714ddb7-f644-47c1-94aa-c7d3288a232e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:22.944365 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c714ddb7-f644-47c1-94aa-c7d3288a232e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:22.945098 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c714ddb7-f644-47c1-94aa-c7d3288a232e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:22.945498 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c714ddb7-f644-47c1-94aa-c7d3288a232e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:22.945956 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c714ddb7-f644-47c1-94aa-c7d3288a232e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:22.946400 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c714ddb7-f644-47c1-94aa-c7d3288a232e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:23.007965 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-84cc09b4-51ce-478c-9922-cff0872cc2f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:23.017459 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-84cc09b4-51ce-478c-9922-cff0872cc2f4 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1512 microversion: 2.1 time: 0.160109 Sep 03 01:38:23.018076 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 386/802] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:22 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1512 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:23.083756 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c714ddb7-f644-47c1-94aa-c7d3288a232e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:23.092586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c714ddb7-f644-47c1-94aa-c7d3288a232e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:23.094005 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c714ddb7-f644-47c1-94aa-c7d3288a232e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:23.095175 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c714ddb7-f644-47c1-94aa-c7d3288a232e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.162720 Sep 03 01:38:23.095731 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 417/803] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:22 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:38:23.426896 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d1ddec57-e338-4e65-bbeb-97908d168b59 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:23.427429 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d1ddec57-e338-4e65-bbeb-97908d168b59 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:23.433736 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d1ddec57-e338-4e65-bbeb-97908d168b59 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:23.434224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d1ddec57-e338-4e65-bbeb-97908d168b59 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:23.434705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d1ddec57-e338-4e65-bbeb-97908d168b59 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:23.435397 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d1ddec57-e338-4e65-bbeb-97908d168b59 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:23.435853 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d1ddec57-e338-4e65-bbeb-97908d168b59 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:23.436280 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d1ddec57-e338-4e65-bbeb-97908d168b59 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:23.536520 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0d220348-791a-4f32-ab96-8062b6be8bda tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:23.537969 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0d220348-791a-4f32-ab96-8062b6be8bda tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:23.544459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0d220348-791a-4f32-ab96-8062b6be8bda tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:23.545010 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0d220348-791a-4f32-ab96-8062b6be8bda tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:23.545443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0d220348-791a-4f32-ab96-8062b6be8bda tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:23.546129 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0d220348-791a-4f32-ab96-8062b6be8bda tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:23.546606 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0d220348-791a-4f32-ab96-8062b6be8bda tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:23.547029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0d220348-791a-4f32-ab96-8062b6be8bda tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:23.569936 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d1ddec57-e338-4e65-bbeb-97908d168b59 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:23.577900 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d1ddec57-e338-4e65-bbeb-97908d168b59 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1452 microversion: 2.1 time: 0.154917 Sep 03 01:38:23.578601 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 387/804] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:23 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1452 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:23.601022 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f9af9b4e-c797-404b-97f2-9075602c3daf tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:23.601842 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f9af9b4e-c797-404b-97f2-9075602c3daf tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:23.608060 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f9af9b4e-c797-404b-97f2-9075602c3daf tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:23.608605 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0d220348-791a-4f32-ab96-8062b6be8bda tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:23.608734 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f9af9b4e-c797-404b-97f2-9075602c3daf tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:23.609195 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f9af9b4e-c797-404b-97f2-9075602c3daf tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:23.609963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f9af9b4e-c797-404b-97f2-9075602c3daf tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:23.610526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f9af9b4e-c797-404b-97f2-9075602c3daf tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:23.610955 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f9af9b4e-c797-404b-97f2-9075602c3daf tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:23.616965 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0d220348-791a-4f32-ab96-8062b6be8bda tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1331 microversion: 2.1 time: 0.084518 Sep 03 01:38:23.617537 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 418/805] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:23 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1331 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:23.741750 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-f9af9b4e-c797-404b-97f2-9075602c3daf tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:23.750129 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f9af9b4e-c797-404b-97f2-9075602c3daf tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1452 microversion: 2.1 time: 0.153858 Sep 03 01:38:23.750728 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 388/806] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:23 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:24.041773 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-4ac0f1c9-138f-4ccc-84d2-28892e79db99 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:24.042600 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-4ac0f1c9-138f-4ccc-84d2-28892e79db99 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:24.048468 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4ac0f1c9-138f-4ccc-84d2-28892e79db99 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:24.048967 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4ac0f1c9-138f-4ccc-84d2-28892e79db99 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:24.049408 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4ac0f1c9-138f-4ccc-84d2-28892e79db99 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:24.050100 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4ac0f1c9-138f-4ccc-84d2-28892e79db99 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:24.050584 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4ac0f1c9-138f-4ccc-84d2-28892e79db99 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:24.051015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4ac0f1c9-138f-4ccc-84d2-28892e79db99 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:24.126631 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a2497c12-b62b-472a-90a0-517bc378f6c4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:24.127767 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a2497c12-b62b-472a-90a0-517bc378f6c4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:24.136713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2497c12-b62b-472a-90a0-517bc378f6c4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:24.137413 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2497c12-b62b-472a-90a0-517bc378f6c4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:24.137847 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2497c12-b62b-472a-90a0-517bc378f6c4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:24.138623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2497c12-b62b-472a-90a0-517bc378f6c4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:24.139078 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2497c12-b62b-472a-90a0-517bc378f6c4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:24.139500 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2497c12-b62b-472a-90a0-517bc378f6c4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:24.290382 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a2497c12-b62b-472a-90a0-517bc378f6c4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:24.290892 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-4ac0f1c9-138f-4ccc-84d2-28892e79db99 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:24.301747 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-4ac0f1c9-138f-4ccc-84d2-28892e79db99 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1512 microversion: 2.1 time: 0.264399 Sep 03 01:38:24.306829 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 419/807] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:24 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1512 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:24.311430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a2497c12-b62b-472a-90a0-517bc378f6c4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:24.313105 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a2497c12-b62b-472a-90a0-517bc378f6c4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:24.314983 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a2497c12-b62b-472a-90a0-517bc378f6c4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.193999 Sep 03 01:38:24.316013 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 389/808] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:24 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:24.641177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-57aa4eff-e422-4778-9daf-9515a9570a62 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:24.641787 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-57aa4eff-e422-4778-9daf-9515a9570a62 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:24.649114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57aa4eff-e422-4778-9daf-9515a9570a62 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:24.649662 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57aa4eff-e422-4778-9daf-9515a9570a62 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:24.650102 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57aa4eff-e422-4778-9daf-9515a9570a62 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:24.650833 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57aa4eff-e422-4778-9daf-9515a9570a62 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:24.651278 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57aa4eff-e422-4778-9daf-9515a9570a62 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:24.651753 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57aa4eff-e422-4778-9daf-9515a9570a62 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:24.757715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-57aa4eff-e422-4778-9daf-9515a9570a62 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:24.768093 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-57aa4eff-e422-4778-9daf-9515a9570a62 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1331 microversion: 2.1 time: 0.130686 Sep 03 01:38:24.776529 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 420/809] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:24 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1331 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:25.328132 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c0ec0a13-6720-4631-9dfa-92fd2b844824 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:25.328731 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c0ec0a13-6720-4631-9dfa-92fd2b844824 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:25.338734 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0ec0a13-6720-4631-9dfa-92fd2b844824 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:25.339226 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0ec0a13-6720-4631-9dfa-92fd2b844824 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:25.339659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0ec0a13-6720-4631-9dfa-92fd2b844824 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:25.340557 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0ec0a13-6720-4631-9dfa-92fd2b844824 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:25.341289 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0ec0a13-6720-4631-9dfa-92fd2b844824 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:25.342019 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0ec0a13-6720-4631-9dfa-92fd2b844824 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:25.345076 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6a4b489b-c75f-460d-8622-7abf4eb8afd3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:25.345685 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6a4b489b-c75f-460d-8622-7abf4eb8afd3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:25.352330 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6a4b489b-c75f-460d-8622-7abf4eb8afd3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:25.352822 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6a4b489b-c75f-460d-8622-7abf4eb8afd3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:25.353254 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6a4b489b-c75f-460d-8622-7abf4eb8afd3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:25.353948 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6a4b489b-c75f-460d-8622-7abf4eb8afd3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:25.354993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6a4b489b-c75f-460d-8622-7abf4eb8afd3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:25.355629 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6a4b489b-c75f-460d-8622-7abf4eb8afd3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:25.512417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c0ec0a13-6720-4631-9dfa-92fd2b844824 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:25.523026 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c0ec0a13-6720-4631-9dfa-92fd2b844824 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1512 microversion: 2.1 time: 0.201197 Sep 03 01:38:25.523859 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 390/810] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:25 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1512 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:25.770297 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-e64c4a95-94fa-46af-a273-fa3d4dc62dfb req-3ae55b95-4c92-4363-bd8b-274e59f2f190 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329ea656-c337-4f07-bd3d-9f67c4d6418e", "name": "network-vif-unplugged", "status": "completed", "tag": "8e331545-f680-453c-942e-5cd9fc274b5f"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:25.782999 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-e64c4a95-94fa-46af-a273-fa3d4dc62dfb req-3ae55b95-4c92-4363-bd8b-274e59f2f190 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:25.784090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-e64c4a95-94fa-46af-a273-fa3d4dc62dfb req-3ae55b95-4c92-4363-bd8b-274e59f2f190 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:25.784634 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-e64c4a95-94fa-46af-a273-fa3d4dc62dfb req-3ae55b95-4c92-4363-bd8b-274e59f2f190 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:25.797839 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-e64c4a95-94fa-46af-a273-fa3d4dc62dfb req-3ae55b95-4c92-4363-bd8b-274e59f2f190 service nova] Creating event network-vif-unplugged:8e331545-f680-453c-942e-5cd9fc274b5f for instance 329ea656-c337-4f07-bd3d-9f67c4d6418e on hv-cinder-83800 Sep 03 01:38:25.806308 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-e64c4a95-94fa-46af-a273-fa3d4dc62dfb req-3ae55b95-4c92-4363-bd8b-274e59f2f190 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040823 Sep 03 01:38:25.806979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 391/811] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:25.813461 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:25.815002 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:25.824426 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:25.824920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:25.825353 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:25.826054 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:25.826576 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:25.827004 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:25.838742 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6a4b489b-c75f-460d-8622-7abf4eb8afd3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:25.845350 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6a4b489b-c75f-460d-8622-7abf4eb8afd3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:25.847256 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6a4b489b-c75f-460d-8622-7abf4eb8afd3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:25.848705 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6a4b489b-c75f-460d-8622-7abf4eb8afd3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1724 microversion: 2.20 time: 0.507548 Sep 03 01:38:25.851050 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 421/812] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:25 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1724 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:25.875765 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:25.876546 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:25.877125 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:25.877689 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lazy-loading 'fault' on Instance uuid 34abe46a-5361-4e96-a952-5909fad8c4f4 {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:38:25.931002 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:25.945141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-cddbafa9-ee40-45f2-9033-8d0b1c15b22d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 200 len: 1336 microversion: 2.1 time: 0.136916 Sep 03 01:38:25.945747 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 392/813] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:25 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 1336 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:26.548123 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ac4788ba-c4da-4360-9092-f80a0d9ae6cc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:26.548871 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ac4788ba-c4da-4360-9092-f80a0d9ae6cc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:26.555504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ac4788ba-c4da-4360-9092-f80a0d9ae6cc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:26.556055 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ac4788ba-c4da-4360-9092-f80a0d9ae6cc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:26.559648 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ac4788ba-c4da-4360-9092-f80a0d9ae6cc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:26.559648 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ac4788ba-c4da-4360-9092-f80a0d9ae6cc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:26.559648 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ac4788ba-c4da-4360-9092-f80a0d9ae6cc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:26.559648 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ac4788ba-c4da-4360-9092-f80a0d9ae6cc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:26.564007 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:26.873976 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5a1a35b7-48d7-4793-9ba0-a43dca33dfb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:26.874627 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5a1a35b7-48d7-4793-9ba0-a43dca33dfb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:26.881213 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a1a35b7-48d7-4793-9ba0-a43dca33dfb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:26.881690 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a1a35b7-48d7-4793-9ba0-a43dca33dfb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:26.882118 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a1a35b7-48d7-4793-9ba0-a43dca33dfb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:26.882832 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a1a35b7-48d7-4793-9ba0-a43dca33dfb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:26.883279 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a1a35b7-48d7-4793-9ba0-a43dca33dfb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:26.883695 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5a1a35b7-48d7-4793-9ba0-a43dca33dfb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:26.937888 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ac4788ba-c4da-4360-9092-f80a0d9ae6cc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:26.944606 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ac4788ba-c4da-4360-9092-f80a0d9ae6cc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1512 microversion: 2.1 time: 0.400257 Sep 03 01:38:26.945506 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 422/814] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:26 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1512 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:26.965655 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5a1a35b7-48d7-4793-9ba0-a43dca33dfb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:26.968859 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-18555c1e-3987-4e32-80c7-d8f3d25a80bf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:26.969715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-18555c1e-3987-4e32-80c7-d8f3d25a80bf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 34abe46a-5361-4e96-a952-5909fad8c4f4] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:26.975431 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5a1a35b7-48d7-4793-9ba0-a43dca33dfb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:26.976764 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-18555c1e-3987-4e32-80c7-d8f3d25a80bf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:26.977144 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5a1a35b7-48d7-4793-9ba0-a43dca33dfb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:26.977503 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-18555c1e-3987-4e32-80c7-d8f3d25a80bf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:26.978039 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-18555c1e-3987-4e32-80c7-d8f3d25a80bf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:26.978306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5a1a35b7-48d7-4793-9ba0-a43dca33dfb0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1656 microversion: 2.20 time: 0.108354 Sep 03 01:38:26.979132 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 393/815] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:26 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1656 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:38:26.979258 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-18555c1e-3987-4e32-80c7-d8f3d25a80bf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:26.985444 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-18555c1e-3987-4e32-80c7-d8f3d25a80bf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:26.986212 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-18555c1e-3987-4e32-80c7-d8f3d25a80bf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:27.001748 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-18555c1e-3987-4e32-80c7-d8f3d25a80bf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] HTTP exception thrown: Instance 34abe46a-5361-4e96-a952-5909fad8c4f4 could not be found. Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-18555c1e-3987-4e32-80c7-d8f3d25a80bf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Request method failure captured: Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 HTTP/1.1 Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7V2ath9gf-whD6tL86b1S7pYvql4QgUyJF1yPAVzgiQ2t6IoM2RYz54SA6JROlCBu6uMndk0hzOd9Xac4ZVRZsWa_GZPp5YK22x3_vfwipYUfM5-C8aj-iUUgX169mfrwWeU8PgX6mea_qND-4fnQAWZMLQqNrq4pPhzc49V3gV8w Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: d93c5a3ef20c4a5b87af4803f820b60e Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:38:27.003343 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:38:27.005002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:38:27.005002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:38:27.005002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: d93c5a3ef20c4a5b87af4803f820b60e Sep 03 01:38:27.005002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:38:27.005002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-ServerRescueNegativeTestJSON-201019967-project Sep 03 01:38:27.005002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:38:27.005002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:38:27.005002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 409c324dca974d9dad9529b2a0d82b30 Sep 03 01:38:27.005002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201019967-project Sep 03 01:38:27.005002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:38:27.005002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 34abe46a-5361-4e96-a952-5909fad8c4f4 could not be found. Sep 03 01:38:27.005002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '34abe46a-5361-4e96-a952-5909fad8c4f4'} Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34abe46a-5361-4e96-a952-5909fad8c4f4 could not be found. Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:38:27.006721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34abe46a-5361-4e96-a952-5909fad8c4f4 could not be found. Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34abe46a-5361-4e96-a952-5909fad8c4f4 could not be found. Sep 03 01:38:27.008599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:27.010022 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-18555c1e-3987-4e32-80c7-d8f3d25a80bf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Returning 404 to user: Instance 34abe46a-5361-4e96-a952-5909fad8c4f4 could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:38:27.010022 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-18555c1e-3987-4e32-80c7-d8f3d25a80bf tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4" status: 404 len: 111 microversion: 2.1 time: 0.040388 Sep 03 01:38:27.010022 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 423/816] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:26 2022] GET /compute/v2.1/servers/34abe46a-5361-4e96-a952-5909fad8c4f4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 01:38:27.014866 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a9ce124a-95fa-485e-9883-e56c88721b4c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '.version_select at 0x7f6d24803f70>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:27.035708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-b8e0dbeb-996a-4bc3-9167-84c1884bee1f req-686ad4ca-2d8a-41a7-bd71-f8a3a8ac0425 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51ed6fe4-9955-4b04-b20d-b2f60e944310", "name": "network-vif-deleted", "tag": "91fcf0db-d435-4413-9523-d181eb8e1ae2"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:27.046232 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-b8e0dbeb-996a-4bc3-9167-84c1884bee1f req-686ad4ca-2d8a-41a7-bd71-f8a3a8ac0425 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:27.046735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-b8e0dbeb-996a-4bc3-9167-84c1884bee1f req-686ad4ca-2d8a-41a7-bd71-f8a3a8ac0425 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:27.047168 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-b8e0dbeb-996a-4bc3-9167-84c1884bee1f req-686ad4ca-2d8a-41a7-bd71-f8a3a8ac0425 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:27.059074 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-b8e0dbeb-996a-4bc3-9167-84c1884bee1f req-686ad4ca-2d8a-41a7-bd71-f8a3a8ac0425 service nova] Creating event network-vif-deleted:91fcf0db-d435-4413-9523-d181eb8e1ae2 for instance 51ed6fe4-9955-4b04-b20d-b2f60e944310 on hv-cinder-83800 Sep 03 01:38:27.064418 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-b8e0dbeb-996a-4bc3-9167-84c1884bee1f req-686ad4ca-2d8a-41a7-bd71-f8a3a8ac0425 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032823 Sep 03 01:38:27.064844 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 424/817] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:38:27.131652 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a9ce124a-95fa-485e-9883-e56c88721b4c tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583236965" status: 202 len: 0 microversion: 2.1 time: 0.119717 Sep 03 01:38:27.132676 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 394/818] 10.222.0.13 () {58 vars in 1221 bytes} [Sat Sep 3 01:38:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1583236965 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:38:27.969778 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:27.970720 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:27.978926 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:27.979872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:27.980469 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:27.981558 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:27.982415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:27.983201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:28.003790 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:28.004501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:28.013689 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:28.014196 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:28.020325 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:28.021158 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:28.022127 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:28.022605 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:28.053433 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:28.053934 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:28.054457 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:28.054907 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lazy-loading 'fault' on Instance uuid 51ed6fe4-9955-4b04-b20d-b2f60e944310 {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:38:28.084734 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:28.085239 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:28.085699 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:28.086146 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lazy-loading 'fault' on Instance uuid 329ea656-c337-4f07-bd3d-9f67c4d6418e {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:38:28.124607 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:28.136513 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:28.140606 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:28.145808 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7ec5b35e-eb5a-4cb2-8a40-f120a05aa478 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 200 len: 1308 microversion: 2.1 time: 0.180950 Sep 03 01:38:28.147613 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:28.151191 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 425/819] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:27 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 1308 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:28.152578 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:28.154504 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c8f7f4e9-fc27-4a74-a1d0-8ab9179d5b1b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 200 len: 1371 microversion: 2.20 time: 0.155513 Sep 03 01:38:28.176290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 395/820] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:27 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:38:28.614146 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-305c1b04-cac9-4157-bc55-cfccfd6fa0b5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:28.617205 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-305c1b04-cac9-4157-bc55-cfccfd6fa0b5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:28.623526 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-305c1b04-cac9-4157-bc55-cfccfd6fa0b5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:28.624030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-305c1b04-cac9-4157-bc55-cfccfd6fa0b5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:28.628246 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-305c1b04-cac9-4157-bc55-cfccfd6fa0b5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:28.628246 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-305c1b04-cac9-4157-bc55-cfccfd6fa0b5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:28.628246 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-305c1b04-cac9-4157-bc55-cfccfd6fa0b5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:28.628246 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-305c1b04-cac9-4157-bc55-cfccfd6fa0b5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:28.667664 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-305c1b04-cac9-4157-bc55-cfccfd6fa0b5 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057348 Sep 03 01:38:28.668255 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 426/821] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:38:28 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 01:38:28.750421 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-524cbb7d-6393-4bd0-8cea-faabedee5ffa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:28.751421 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-524cbb7d-6393-4bd0-8cea-faabedee5ffa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:28.759243 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-524cbb7d-6393-4bd0-8cea-faabedee5ffa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:28.759818 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-524cbb7d-6393-4bd0-8cea-faabedee5ffa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:28.760338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-524cbb7d-6393-4bd0-8cea-faabedee5ffa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:28.761352 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-524cbb7d-6393-4bd0-8cea-faabedee5ffa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:28.762059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-524cbb7d-6393-4bd0-8cea-faabedee5ffa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:28.762734 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-524cbb7d-6393-4bd0-8cea-faabedee5ffa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:28.793312 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-524cbb7d-6393-4bd0-8cea-faabedee5ffa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:38:29.089783 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-0b1a4aa9-bad2-478f-b021-03b68f4978b3 req-4f1002e6-7804-4ffc-840f-655dc6e11721 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "329ea656-c337-4f07-bd3d-9f67c4d6418e", "name": "network-vif-deleted", "tag": "8e331545-f680-453c-942e-5cd9fc274b5f"}, {"name": "network-changed", "server_uuid": "843467ed-5454-46d9-8626-619ff8f27fd9", "tag": "f3456acb-4580-4e62-9494-7b8fd05f264e"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:29.102746 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-0b1a4aa9-bad2-478f-b021-03b68f4978b3 req-4f1002e6-7804-4ffc-840f-655dc6e11721 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:29.106008 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-0b1a4aa9-bad2-478f-b021-03b68f4978b3 req-4f1002e6-7804-4ffc-840f-655dc6e11721 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:29.106008 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-0b1a4aa9-bad2-478f-b021-03b68f4978b3 req-4f1002e6-7804-4ffc-840f-655dc6e11721 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:29.118394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-0b1a4aa9-bad2-478f-b021-03b68f4978b3 req-4f1002e6-7804-4ffc-840f-655dc6e11721 service nova] Creating event network-vif-deleted:8e331545-f680-453c-942e-5cd9fc274b5f for instance 329ea656-c337-4f07-bd3d-9f67c4d6418e on hv-cinder-83800 Sep 03 01:38:29.118899 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-0b1a4aa9-bad2-478f-b021-03b68f4978b3 req-4f1002e6-7804-4ffc-840f-655dc6e11721 service nova] Creating event network-changed:f3456acb-4580-4e62-9494-7b8fd05f264e for instance 843467ed-5454-46d9-8626-619ff8f27fd9 on hv-cinder-83800 Sep 03 01:38:29.125681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-0b1a4aa9-bad2-478f-b021-03b68f4978b3 req-4f1002e6-7804-4ffc-840f-655dc6e11721 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.045228 Sep 03 01:38:29.126295 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 427/822] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:29 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:29.177134 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c3ff7907-cb54-4b87-97e2-ff24fdd4e294 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:29.178621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c3ff7907-cb54-4b87-97e2-ff24fdd4e294 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 51ed6fe4-9955-4b04-b20d-b2f60e944310] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:29.181631 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-524cbb7d-6393-4bd0-8cea-faabedee5ffa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 204 len: 0 microversion: 2.1 time: 0.435094 Sep 03 01:38:29.182638 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 396/823] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:38:28 2022] DELETE /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:38:29.187843 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c3ff7907-cb54-4b87-97e2-ff24fdd4e294 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:29.190821 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c3ff7907-cb54-4b87-97e2-ff24fdd4e294 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:29.190821 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c3ff7907-cb54-4b87-97e2-ff24fdd4e294 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:29.191003 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-aef41e94-ebbc-4410-a592-2f368d90f578 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:29.191135 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c3ff7907-cb54-4b87-97e2-ff24fdd4e294 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:29.191245 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-aef41e94-ebbc-4410-a592-2f368d90f578 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:29.191358 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c3ff7907-cb54-4b87-97e2-ff24fdd4e294 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:29.191358 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c3ff7907-cb54-4b87-97e2-ff24fdd4e294 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:29.196915 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aef41e94-ebbc-4410-a592-2f368d90f578 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:29.197733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aef41e94-ebbc-4410-a592-2f368d90f578 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:29.198263 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aef41e94-ebbc-4410-a592-2f368d90f578 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:29.199115 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aef41e94-ebbc-4410-a592-2f368d90f578 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:29.199908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aef41e94-ebbc-4410-a592-2f368d90f578 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:29.200429 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aef41e94-ebbc-4410-a592-2f368d90f578 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:29.205371 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-c3ff7907-cb54-4b87-97e2-ff24fdd4e294 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] HTTP exception thrown: Instance 51ed6fe4-9955-4b04-b20d-b2f60e944310 could not be found. Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c3ff7907-cb54-4b87-97e2-ff24fdd4e294 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Request method failure captured: Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 HTTP/1.1 Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq-zpY9VpYsYtSWFChmJKWPC97HvlGUZS8YEArgQQg0k4Gzt7a8M5Z007EL36W-GO4YAPBsf5j_-5Bed_pKwtuLehqlyUyhuLJdtNGSvGEq5jJn8tXMfsUgVvx87EQV7cg3vxj40nbO1HpOrGQLoWj0rWkvoI2_3RduNY6xq44KRZsU Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: efb12fa605334996a0e25888c90a108a Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-VolumesSnapshotTestJSON-759650107 Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:38:29.207298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:38:29.212653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_efb12fa605334996a0e25888c90a108a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/efb12fa605334996a0e25888c90a108a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/efb12fa605334996a0e25888c90a108a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/efb12fa605334996a0e25888c90a108a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:38:29.212653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-VolumesSnapshotTestJSON-759650107 Sep 03 01:38:29.212653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: efb12fa605334996a0e25888c90a108a Sep 03 01:38:29.212653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-759650107 Sep 03 01:38:29.212653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-VolumesSnapshotTestJSON-759650107-project Sep 03 01:38:29.212653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:38:29.212653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:38:29.212653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 69028bf5296541b6bfe9595d684c6567 Sep 03 01:38:29.212653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-VolumesSnapshotTestJSON-759650107-project Sep 03 01:38:29.212653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:38:29.212653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 51ed6fe4-9955-4b04-b20d-b2f60e944310 could not be found. Sep 03 01:38:29.212653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '51ed6fe4-9955-4b04-b20d-b2f60e944310'} Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51ed6fe4-9955-4b04-b20d-b2f60e944310 could not be found. Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:38:29.213412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51ed6fe4-9955-4b04-b20d-b2f60e944310 could not be found. Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51ed6fe4-9955-4b04-b20d-b2f60e944310 could not be found. Sep 03 01:38:29.218717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:29.221084 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c3ff7907-cb54-4b87-97e2-ff24fdd4e294 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Returning 404 to user: Instance 51ed6fe4-9955-4b04-b20d-b2f60e944310 could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:38:29.221084 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c3ff7907-cb54-4b87-97e2-ff24fdd4e294 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310" status: 404 len: 111 microversion: 2.1 time: 0.036545 Sep 03 01:38:29.221084 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 428/824] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:29 2022] GET /compute/v2.1/servers/51ed6fe4-9955-4b04-b20d-b2f60e944310 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 01:38:29.224372 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-aef41e94-ebbc-4410-a592-2f368d90f578 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] HTTP exception thrown: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-aef41e94-ebbc-4410-a592-2f368d90f578 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Request method failure captured: Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e HTTP/1.1 Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7T4S5vaLoLkOelO1eKAZ94SsvgKx8nn0PlHVaKc3S3IfkHIWadTLp9Vho3tjTiMstVyv50HnZd5E16qwBjEuPO4KxgJI77i5_IhmusF5pyRLA2NqvyQ7TtQ6_6hiiIGiUeK4D5WGusqnjHzmw7njr2bwxZv5Ys82XSSEJ7DcNysls Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: e09bed4b9f9741a8ab110a2676baee7f Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:38:29.227202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:38:29.229873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:38:29.229873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:38:29.229873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: e09bed4b9f9741a8ab110a2676baee7f Sep 03 01:38:29.229873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:38:29.229873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-AttachVolumeShelveTestJSON-636719635-project Sep 03 01:38:29.229873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:38:29.229873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:38:29.229873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 29b4f0836bbf4684bdc6177e42b88b20 Sep 03 01:38:29.229873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-636719635-project Sep 03 01:38:29.229873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:38:29.229873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:38:29.229873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '329ea656-c337-4f07-bd3d-9f67c4d6418e'} Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:38:29.231296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:38:29.234823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:38:29.241873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-aef41e94-ebbc-4410-a592-2f368d90f578 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Returning 404 to user: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:38:29.241873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-aef41e94-ebbc-4410-a592-2f368d90f578 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 404 len: 111 microversion: 2.20 time: 0.044631 Sep 03 01:38:29.241873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 397/825] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:29 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 01:38:29.242245 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5e7a73b0-6c60-4f62-9086-c0bad76cea22 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:29.242245 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5e7a73b0-6c60-4f62-9086-c0bad76cea22 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:29.242245 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5e7a73b0-6c60-4f62-9086-c0bad76cea22 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:29.242245 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5e7a73b0-6c60-4f62-9086-c0bad76cea22 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:29.242654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5e7a73b0-6c60-4f62-9086-c0bad76cea22 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:29.242742 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1df9ae6c-377d-4d26-9e87-7bd677d9fd2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '.version_select at 0x7f6d247d78b0>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:29.242831 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5e7a73b0-6c60-4f62-9086-c0bad76cea22 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:29.242831 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5e7a73b0-6c60-4f62-9086-c0bad76cea22 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:29.242831 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5e7a73b0-6c60-4f62-9086-c0bad76cea22 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:29.319388 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1df9ae6c-377d-4d26-9e87-7bd677d9fd2a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1948356925" status: 204 len: 0 microversion: 2.20 time: 0.084922 Sep 03 01:38:29.320353 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 398/826] 10.222.0.13 () {60 vars in 1262 bytes} [Sat Sep 3 01:38:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1948356925 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 01:38:29.381439 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5e7a73b0-6c60-4f62-9086-c0bad76cea22 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:29.389146 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5e7a73b0-6c60-4f62-9086-c0bad76cea22 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1675 microversion: 2.1 time: 0.178558 Sep 03 01:38:29.389712 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 429/827] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:29 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1675 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:30.137776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d344525f-8733-4582-8106-a5fe6bd2b58b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Action: 'create', calling method: .version_select at 0x7f6d2481f160>, body: {"keypair": {"name": "tempest-keypair-2010752069", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPNVZGlbtiigWXX0749xVrN04FS9CCesXEiAsDlZhy2+B+d7C37q2mL7akkA4ksChz19GWJpILsP+jpDDRppqVdWNwbl2TJbkfJyJn/6UvWmdiDaURb693FYvQBhKCajdw=="}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:30.154325 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-d344525f-8733-4582-8106-a5fe6bd2b58b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Getting quotas for project e09bed4b9f9741a8ab110a2676baee7f. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:38:30.158511 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-d344525f-8733-4582-8106-a5fe6bd2b58b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Getting quotas for user 29b4f0836bbf4684bdc6177e42b88b20 and project e09bed4b9f9741a8ab110a2676baee7f. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:38:30.244241 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d344525f-8733-4582-8106-a5fe6bd2b58b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.110872 Sep 03 01:38:30.244889 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 399/828] 10.222.0.13 () {62 vars in 1200 bytes} [Sat Sep 3 01:38:30 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 112 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 03 01:38:30.412825 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-55d630f4-a06c-43ba-a4a0-5519693558f6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:30.413370 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-55d630f4-a06c-43ba-a4a0-5519693558f6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:30.419936 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55d630f4-a06c-43ba-a4a0-5519693558f6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:30.420431 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55d630f4-a06c-43ba-a4a0-5519693558f6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:30.420867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55d630f4-a06c-43ba-a4a0-5519693558f6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:30.421559 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55d630f4-a06c-43ba-a4a0-5519693558f6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:30.422013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55d630f4-a06c-43ba-a4a0-5519693558f6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:30.422474 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55d630f4-a06c-43ba-a4a0-5519693558f6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:30.583031 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-55d630f4-a06c-43ba-a4a0-5519693558f6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:30.591342 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-55d630f4-a06c-43ba-a4a0-5519693558f6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1675 microversion: 2.1 time: 0.182568 Sep 03 01:38:30.591911 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 430/829] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:30 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1675 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:31.615290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-378a4ca5-b736-470c-a967-790b348aff1d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:31.616009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-378a4ca5-b736-470c-a967-790b348aff1d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:31.617798 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:31.622581 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-378a4ca5-b736-470c-a967-790b348aff1d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:31.623060 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-378a4ca5-b736-470c-a967-790b348aff1d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:31.623485 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-378a4ca5-b736-470c-a967-790b348aff1d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:31.624163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-378a4ca5-b736-470c-a967-790b348aff1d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:31.624612 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-378a4ca5-b736-470c-a967-790b348aff1d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:31.625030 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-378a4ca5-b736-470c-a967-790b348aff1d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:31.758703 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-378a4ca5-b736-470c-a967-790b348aff1d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:31.768796 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-378a4ca5-b736-470c-a967-790b348aff1d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1675 microversion: 2.1 time: 0.157930 Sep 03 01:38:31.770744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 400/830] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:31 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:32.312245 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-254072973", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9f4d104-d756-4b2b-9b1c-81ea8775b5d5"}], "security_groups": [{"name": "tempest-securitygroup--1247107772"}], "key_name": "tempest-keypair-2010752069", "user_data": "}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:32.322125 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:32.421219 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.network.neutron [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] validate_networks() for [('b9f4d104-d756-4b2b-9b1c-81ea8775b5d5', None, None, None, None, None)] {{(pid=127552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:38:32.793470 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-84ea54cb-8e0a-479f-9d14-ce6b370cc009 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:32.794081 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-84ea54cb-8e0a-479f-9d14-ce6b370cc009 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:32.811276 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-84ea54cb-8e0a-479f-9d14-ce6b370cc009 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:32.811773 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-84ea54cb-8e0a-479f-9d14-ce6b370cc009 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:32.812210 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-84ea54cb-8e0a-479f-9d14-ce6b370cc009 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:32.812924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-84ea54cb-8e0a-479f-9d14-ce6b370cc009 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:32.813396 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-84ea54cb-8e0a-479f-9d14-ce6b370cc009 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:32.813883 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-84ea54cb-8e0a-479f-9d14-ce6b370cc009 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:32.960567 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-84ea54cb-8e0a-479f-9d14-ce6b370cc009 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:32.969181 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-84ea54cb-8e0a-479f-9d14-ce6b370cc009 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1675 microversion: 2.1 time: 0.179470 Sep 03 01:38:32.975100 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 401/831] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:32 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:32.978257 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Flavor limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:38:32.978704 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Image limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:38:32.979168 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Flavor pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:38:32.979989 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Image pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:38:32.979989 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:38:32.988752 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:32.989234 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:32.989696 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:32.991333 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:32.991786 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:32.992227 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:33.009537 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Getting quotas for project e09bed4b9f9741a8ab110a2676baee7f. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:38:33.013655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Getting quotas for user 29b4f0836bbf4684bdc6177e42b88b20 and project e09bed4b9f9741a8ab110a2676baee7f. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:38:33.025112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Going to run 1 instances... {{(pid=127552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:38:33.028902 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:38:33.268944 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-01c748c3-43b8-4e66-a0f0-70d48650bda2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.960971 Sep 03 01:38:33.269849 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 431/832] 10.222.0.13 () {62 vars in 1188 bytes} [Sat Sep 3 01:38:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 962 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 03 01:38:33.287852 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1a2bb250-51ae-4f3e-9b0f-21b6bbd952ef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:33.289082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1a2bb250-51ae-4f3e-9b0f-21b6bbd952ef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:33.381592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1a2bb250-51ae-4f3e-9b0f-21b6bbd952ef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:33.390072 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1a2bb250-51ae-4f3e-9b0f-21b6bbd952ef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:33.392243 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1a2bb250-51ae-4f3e-9b0f-21b6bbd952ef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:33.407076 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1a2bb250-51ae-4f3e-9b0f-21b6bbd952ef tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1281 microversion: 2.20 time: 0.128602 Sep 03 01:38:33.408321 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 402/833] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:33 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1281 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:38:33.997070 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a51ac4f4-df06-42e0-90e3-0aa3e86c391b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:33.997769 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a3079408-b9a9-4a09-8287-de249b3f3134 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:33.998158 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a51ac4f4-df06-42e0-90e3-0aa3e86c391b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:33.998257 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a3079408-b9a9-4a09-8287-de249b3f3134 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:34.004215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a51ac4f4-df06-42e0-90e3-0aa3e86c391b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:34.004383 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a3079408-b9a9-4a09-8287-de249b3f3134 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:34.007507 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a51ac4f4-df06-42e0-90e3-0aa3e86c391b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:34.007650 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a3079408-b9a9-4a09-8287-de249b3f3134 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:34.007756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a51ac4f4-df06-42e0-90e3-0aa3e86c391b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:34.007854 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a3079408-b9a9-4a09-8287-de249b3f3134 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:34.007960 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a51ac4f4-df06-42e0-90e3-0aa3e86c391b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:34.008052 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a3079408-b9a9-4a09-8287-de249b3f3134 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:34.008052 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a3079408-b9a9-4a09-8287-de249b3f3134 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:34.008216 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a51ac4f4-df06-42e0-90e3-0aa3e86c391b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:34.008216 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a51ac4f4-df06-42e0-90e3-0aa3e86c391b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:34.008473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a3079408-b9a9-4a09-8287-de249b3f3134 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:34.036421 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a51ac4f4-df06-42e0-90e3-0aa3e86c391b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:38:34.228751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a3079408-b9a9-4a09-8287-de249b3f3134 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:34.234062 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a3079408-b9a9-4a09-8287-de249b3f3134 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1675 microversion: 2.1 time: 0.240848 Sep 03 01:38:34.234924 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 432/834] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:33 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1675 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:34.435170 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-105cd068-2b83-4040-85af-1bdfec84939b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:34.435956 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-105cd068-2b83-4040-85af-1bdfec84939b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:34.442173 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-105cd068-2b83-4040-85af-1bdfec84939b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:34.442761 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-105cd068-2b83-4040-85af-1bdfec84939b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:34.443251 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-105cd068-2b83-4040-85af-1bdfec84939b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:34.444002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-105cd068-2b83-4040-85af-1bdfec84939b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:34.444456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-105cd068-2b83-4040-85af-1bdfec84939b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:34.444878 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-105cd068-2b83-4040-85af-1bdfec84939b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:34.502867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a51ac4f4-df06-42e0-90e3-0aa3e86c391b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 204 len: 0 microversion: 2.1 time: 0.509240 Sep 03 01:38:34.503549 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 403/835] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:38:33 2022] DELETE /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:38:34.512695 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5d574bea-0b3d-4ccf-b4f5-5ab1f91c737b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:34.513644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5d574bea-0b3d-4ccf-b4f5-5ab1f91c737b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:34.523342 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d574bea-0b3d-4ccf-b4f5-5ab1f91c737b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:34.524084 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d574bea-0b3d-4ccf-b4f5-5ab1f91c737b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:34.524697 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d574bea-0b3d-4ccf-b4f5-5ab1f91c737b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:34.525578 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d574bea-0b3d-4ccf-b4f5-5ab1f91c737b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:34.526177 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d574bea-0b3d-4ccf-b4f5-5ab1f91c737b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:34.526893 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d574bea-0b3d-4ccf-b4f5-5ab1f91c737b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:34.542872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-105cd068-2b83-4040-85af-1bdfec84939b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:34.554432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-105cd068-2b83-4040-85af-1bdfec84939b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:34.555906 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-105cd068-2b83-4040-85af-1bdfec84939b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:34.557219 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-105cd068-2b83-4040-85af-1bdfec84939b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1285 microversion: 2.20 time: 0.127896 Sep 03 01:38:34.557907 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 433/836] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:34 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:38:34.700419 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5d574bea-0b3d-4ccf-b4f5-5ab1f91c737b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:34.708062 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5d574bea-0b3d-4ccf-b4f5-5ab1f91c737b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1507 microversion: 2.1 time: 0.199561 Sep 03 01:38:34.709035 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 404/837] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:34 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1507 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:34.808627 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-23967012-4805-4981-9fc0-9328b414c543 req-dd6d3cce-4477-48b9-a710-c97ae7e2b33c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0fef20f-3dfd-4d65-b5ed-50f3caaa011f", "name": "network-vif-deleted", "tag": "e8b8b19d-91b5-4b5a-a71d-5c995462d419"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:34.819916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-23967012-4805-4981-9fc0-9328b414c543 req-dd6d3cce-4477-48b9-a710-c97ae7e2b33c service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:34.820853 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-23967012-4805-4981-9fc0-9328b414c543 req-dd6d3cce-4477-48b9-a710-c97ae7e2b33c service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:34.821518 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-23967012-4805-4981-9fc0-9328b414c543 req-dd6d3cce-4477-48b9-a710-c97ae7e2b33c service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:34.839095 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-23967012-4805-4981-9fc0-9328b414c543 req-dd6d3cce-4477-48b9-a710-c97ae7e2b33c service nova] Creating event network-vif-deleted:e8b8b19d-91b5-4b5a-a71d-5c995462d419 for instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f on hv-cinder-83800 Sep 03 01:38:34.844359 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-23967012-4805-4981-9fc0-9328b414c543 req-dd6d3cce-4477-48b9-a710-c97ae7e2b33c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110158 Sep 03 01:38:34.845242 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 434/838] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:35.257895 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-088682a3-58f5-4242-aa94-416ef72efa6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:35.258626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-088682a3-58f5-4242-aa94-416ef72efa6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:35.264727 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-088682a3-58f5-4242-aa94-416ef72efa6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:35.265209 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-088682a3-58f5-4242-aa94-416ef72efa6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:35.265641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-088682a3-58f5-4242-aa94-416ef72efa6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:35.266327 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-088682a3-58f5-4242-aa94-416ef72efa6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:35.266796 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-088682a3-58f5-4242-aa94-416ef72efa6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:35.267217 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-088682a3-58f5-4242-aa94-416ef72efa6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:35.330128 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-088682a3-58f5-4242-aa94-416ef72efa6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:35.337980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-088682a3-58f5-4242-aa94-416ef72efa6e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1608 microversion: 2.1 time: 0.084384 Sep 03 01:38:35.338891 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 405/839] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:35 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1608 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:35.587677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-85a7cd9b-55aa-46ac-87fb-14a3d3e2013b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:35.588375 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-85a7cd9b-55aa-46ac-87fb-14a3d3e2013b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:35.594927 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-85a7cd9b-55aa-46ac-87fb-14a3d3e2013b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:35.595504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-85a7cd9b-55aa-46ac-87fb-14a3d3e2013b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:35.595956 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-85a7cd9b-55aa-46ac-87fb-14a3d3e2013b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:35.596649 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-85a7cd9b-55aa-46ac-87fb-14a3d3e2013b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:35.597099 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-85a7cd9b-55aa-46ac-87fb-14a3d3e2013b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:35.597524 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-85a7cd9b-55aa-46ac-87fb-14a3d3e2013b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:35.662668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-85a7cd9b-55aa-46ac-87fb-14a3d3e2013b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:35.670991 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-85a7cd9b-55aa-46ac-87fb-14a3d3e2013b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:35.672423 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-85a7cd9b-55aa-46ac-87fb-14a3d3e2013b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:35.673521 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-85a7cd9b-55aa-46ac-87fb-14a3d3e2013b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1277 microversion: 2.20 time: 0.090889 Sep 03 01:38:35.674079 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 435/840] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:35 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:35.732075 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-996ee58f-9e7d-4cd1-86b1-e859e2435693 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:35.732599 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-996ee58f-9e7d-4cd1-86b1-e859e2435693 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:35.739098 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-996ee58f-9e7d-4cd1-86b1-e859e2435693 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:35.739630 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-996ee58f-9e7d-4cd1-86b1-e859e2435693 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:35.740088 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-996ee58f-9e7d-4cd1-86b1-e859e2435693 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:35.740759 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-996ee58f-9e7d-4cd1-86b1-e859e2435693 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:35.741221 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-996ee58f-9e7d-4cd1-86b1-e859e2435693 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:35.741624 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-996ee58f-9e7d-4cd1-86b1-e859e2435693 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:35.877779 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-996ee58f-9e7d-4cd1-86b1-e859e2435693 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:35.885897 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-996ee58f-9e7d-4cd1-86b1-e859e2435693 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1507 microversion: 2.1 time: 0.157833 Sep 03 01:38:35.886483 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 406/841] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:35 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:36.361158 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2f946ad8-779c-45a7-8b67-76a5370856bf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:36.362271 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2f946ad8-779c-45a7-8b67-76a5370856bf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:36.368723 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2f946ad8-779c-45a7-8b67-76a5370856bf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:36.369216 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2f946ad8-779c-45a7-8b67-76a5370856bf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:36.369654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2f946ad8-779c-45a7-8b67-76a5370856bf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:36.370415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2f946ad8-779c-45a7-8b67-76a5370856bf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:36.370870 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2f946ad8-779c-45a7-8b67-76a5370856bf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:36.371295 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2f946ad8-779c-45a7-8b67-76a5370856bf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:36.437457 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2f946ad8-779c-45a7-8b67-76a5370856bf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:36.445284 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2f946ad8-779c-45a7-8b67-76a5370856bf tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1608 microversion: 2.1 time: 0.088102 Sep 03 01:38:36.445855 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 436/842] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:36 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1608 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:36.700298 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5272208e-e125-4c88-af75-1d530fb36c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:36.700936 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5272208e-e125-4c88-af75-1d530fb36c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:36.706809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5272208e-e125-4c88-af75-1d530fb36c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:36.707286 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5272208e-e125-4c88-af75-1d530fb36c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:36.707720 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5272208e-e125-4c88-af75-1d530fb36c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:36.708398 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5272208e-e125-4c88-af75-1d530fb36c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:36.709524 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5272208e-e125-4c88-af75-1d530fb36c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:36.709969 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5272208e-e125-4c88-af75-1d530fb36c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:36.768945 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5272208e-e125-4c88-af75-1d530fb36c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:36.777757 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5272208e-e125-4c88-af75-1d530fb36c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:36.779225 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5272208e-e125-4c88-af75-1d530fb36c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:36.780308 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5272208e-e125-4c88-af75-1d530fb36c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1277 microversion: 2.20 time: 0.083861 Sep 03 01:38:36.780867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 407/843] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:36 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1277 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:36.910007 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-bf794673-67a1-499d-96a0-eac1f5f7265b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:36.910566 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-bf794673-67a1-499d-96a0-eac1f5f7265b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:36.917439 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bf794673-67a1-499d-96a0-eac1f5f7265b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:36.917928 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bf794673-67a1-499d-96a0-eac1f5f7265b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:36.918384 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bf794673-67a1-499d-96a0-eac1f5f7265b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:36.919075 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bf794673-67a1-499d-96a0-eac1f5f7265b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:36.919527 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bf794673-67a1-499d-96a0-eac1f5f7265b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:36.919955 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bf794673-67a1-499d-96a0-eac1f5f7265b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:37.048209 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bf794673-67a1-499d-96a0-eac1f5f7265b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:37.056329 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-bf794673-67a1-499d-96a0-eac1f5f7265b tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1507 microversion: 2.1 time: 0.150622 Sep 03 01:38:37.056908 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 437/844] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:36 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:37.468808 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cbea5649-9668-4c57-9847-a56a00946ce3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:37.469426 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-cbea5649-9668-4c57-9847-a56a00946ce3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:37.476304 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cbea5649-9668-4c57-9847-a56a00946ce3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:37.476792 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cbea5649-9668-4c57-9847-a56a00946ce3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:37.477253 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cbea5649-9668-4c57-9847-a56a00946ce3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:37.477925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cbea5649-9668-4c57-9847-a56a00946ce3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:37.478402 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cbea5649-9668-4c57-9847-a56a00946ce3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:37.478832 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cbea5649-9668-4c57-9847-a56a00946ce3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:37.541079 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cbea5649-9668-4c57-9847-a56a00946ce3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:37.549171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-cbea5649-9668-4c57-9847-a56a00946ce3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1608 microversion: 2.1 time: 0.084247 Sep 03 01:38:37.549998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 408/845] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:37 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1608 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:37.806417 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-4c09dfe0-2576-4e09-b760-a832247f1aa8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:37.806563 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-4c09dfe0-2576-4e09-b760-a832247f1aa8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:37.812560 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4c09dfe0-2576-4e09-b760-a832247f1aa8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:37.813042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4c09dfe0-2576-4e09-b760-a832247f1aa8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:37.813474 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4c09dfe0-2576-4e09-b760-a832247f1aa8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:37.814158 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4c09dfe0-2576-4e09-b760-a832247f1aa8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:37.814632 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4c09dfe0-2576-4e09-b760-a832247f1aa8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:37.815086 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4c09dfe0-2576-4e09-b760-a832247f1aa8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:37.877637 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-4c09dfe0-2576-4e09-b760-a832247f1aa8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:37.886435 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-4c09dfe0-2576-4e09-b760-a832247f1aa8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:37.887880 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-4c09dfe0-2576-4e09-b760-a832247f1aa8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:37.888971 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-4c09dfe0-2576-4e09-b760-a832247f1aa8 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1277 microversion: 2.20 time: 0.087547 Sep 03 01:38:37.889522 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 438/846] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:37 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:38.080105 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c0fcb319-fb39-4df5-8dd9-74b2d5e6b591 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:38.080629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c0fcb319-fb39-4df5-8dd9-74b2d5e6b591 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:38.087083 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0fcb319-fb39-4df5-8dd9-74b2d5e6b591 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:38.087563 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0fcb319-fb39-4df5-8dd9-74b2d5e6b591 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:38.087997 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0fcb319-fb39-4df5-8dd9-74b2d5e6b591 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:38.088682 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0fcb319-fb39-4df5-8dd9-74b2d5e6b591 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:38.089135 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0fcb319-fb39-4df5-8dd9-74b2d5e6b591 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:38.089561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c0fcb319-fb39-4df5-8dd9-74b2d5e6b591 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:38.219437 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c0fcb319-fb39-4df5-8dd9-74b2d5e6b591 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:38.226453 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c0fcb319-fb39-4df5-8dd9-74b2d5e6b591 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1507 microversion: 2.1 time: 0.150315 Sep 03 01:38:38.227018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 409/847] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:38 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:38.572976 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8f8ffdd7-7246-4588-afdd-0bb1b083175c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:38.573581 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-8f8ffdd7-7246-4588-afdd-0bb1b083175c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:38.580328 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8f8ffdd7-7246-4588-afdd-0bb1b083175c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:38.580866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8f8ffdd7-7246-4588-afdd-0bb1b083175c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:38.581248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8f8ffdd7-7246-4588-afdd-0bb1b083175c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:38.582053 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8f8ffdd7-7246-4588-afdd-0bb1b083175c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:38.582506 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8f8ffdd7-7246-4588-afdd-0bb1b083175c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:38.582849 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8f8ffdd7-7246-4588-afdd-0bb1b083175c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:38.651177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8f8ffdd7-7246-4588-afdd-0bb1b083175c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:38.656879 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-8f8ffdd7-7246-4588-afdd-0bb1b083175c tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1608 microversion: 2.1 time: 0.087658 Sep 03 01:38:38.660638 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 439/848] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:38 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1608 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:38.914425 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7c32969c-3631-43cc-8329-786605f4eaa3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:38.915026 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7c32969c-3631-43cc-8329-786605f4eaa3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:38.920950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c32969c-3631-43cc-8329-786605f4eaa3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:38.921422 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c32969c-3631-43cc-8329-786605f4eaa3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:38.921850 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c32969c-3631-43cc-8329-786605f4eaa3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:38.922558 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c32969c-3631-43cc-8329-786605f4eaa3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:38.923009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c32969c-3631-43cc-8329-786605f4eaa3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:38.923429 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7c32969c-3631-43cc-8329-786605f4eaa3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:38.991928 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7c32969c-3631-43cc-8329-786605f4eaa3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:39.000596 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7c32969c-3631-43cc-8329-786605f4eaa3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:39.005438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7c32969c-3631-43cc-8329-786605f4eaa3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:39.005438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7c32969c-3631-43cc-8329-786605f4eaa3 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1333 microversion: 2.20 time: 0.093442 Sep 03 01:38:39.005438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 410/849] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:38 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1333 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:39.253615 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-81921b4f-7706-41db-919d-f5d760a58d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:39.254567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-81921b4f-7706-41db-919d-f5d760a58d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:39.262822 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-81921b4f-7706-41db-919d-f5d760a58d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:39.263539 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-81921b4f-7706-41db-919d-f5d760a58d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:39.264580 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-81921b4f-7706-41db-919d-f5d760a58d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:39.265303 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-81921b4f-7706-41db-919d-f5d760a58d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:39.265584 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-81921b4f-7706-41db-919d-f5d760a58d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:39.265930 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-81921b4f-7706-41db-919d-f5d760a58d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:39.483194 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-81921b4f-7706-41db-919d-f5d760a58d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:39.491503 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-81921b4f-7706-41db-919d-f5d760a58d29 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1507 microversion: 2.1 time: 0.246171 Sep 03 01:38:39.492079 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 440/850] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:39 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1507 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:39.684913 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:39.686780 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:39.695721 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:39.696431 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:39.697027 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:39.697732 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:39.698190 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:39.698632 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:39.734578 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:39.735069 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:39.735511 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:39.735963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lazy-loading 'fault' on Instance uuid a0fef20f-3dfd-4d65-b5ed-50f3caaa011f {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:38:39.749247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-8a131509-de05-443e-b218-21334f60edbf req-c5d7398b-25df-4d4c-ae0d-2f9b58b40c43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "615f8d7e-2e14-4015-a24f-2b02e885ef44", "name": "network-vif-deleted", "tag": "9ab23d97-93c5-443a-a734-fe9f47c27341"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:39.771950 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-8a131509-de05-443e-b218-21334f60edbf req-c5d7398b-25df-4d4c-ae0d-2f9b58b40c43 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:39.775751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-8a131509-de05-443e-b218-21334f60edbf req-c5d7398b-25df-4d4c-ae0d-2f9b58b40c43 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:39.781132 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:39.782156 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-8a131509-de05-443e-b218-21334f60edbf req-c5d7398b-25df-4d4c-ae0d-2f9b58b40c43 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:39.791405 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f59e08fd-5dcb-46b4-aefd-40d5e48c78e2 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 200 len: 1328 microversion: 2.1 time: 0.114077 Sep 03 01:38:39.792900 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 411/851] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:39 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 1328 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:39.808183 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-8a131509-de05-443e-b218-21334f60edbf req-c5d7398b-25df-4d4c-ae0d-2f9b58b40c43 service nova] Creating event network-vif-deleted:9ab23d97-93c5-443a-a734-fe9f47c27341 for instance 615f8d7e-2e14-4015-a24f-2b02e885ef44 on hv-cinder-83800 Sep 03 01:38:39.813340 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-8a131509-de05-443e-b218-21334f60edbf req-c5d7398b-25df-4d4c-ae0d-2f9b58b40c43 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067938 Sep 03 01:38:39.813949 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 441/852] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:39.917264 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2013082893", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "networks": [{"uuid": "9c419ae7-3777-49c3-b6cf-a135a623993c"}]}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:39.987818 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.network.neutron [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] validate_networks() for [('9c419ae7-3777-49c3-b6cf-a135a623993c', None, None, None, None, None)] {{(pid=127553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:38:40.029742 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-84833475-25d8-4709-ad53-7e2e9179f41d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:40.030516 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-84833475-25d8-4709-ad53-7e2e9179f41d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:40.038147 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-84833475-25d8-4709-ad53-7e2e9179f41d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:40.040397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-84833475-25d8-4709-ad53-7e2e9179f41d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:40.040397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-84833475-25d8-4709-ad53-7e2e9179f41d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:40.040397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-84833475-25d8-4709-ad53-7e2e9179f41d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:40.040397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-84833475-25d8-4709-ad53-7e2e9179f41d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:40.040752 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-84833475-25d8-4709-ad53-7e2e9179f41d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:40.109917 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-84833475-25d8-4709-ad53-7e2e9179f41d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:40.119027 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-84833475-25d8-4709-ad53-7e2e9179f41d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:40.120707 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-84833475-25d8-4709-ad53-7e2e9179f41d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:40.121848 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-84833475-25d8-4709-ad53-7e2e9179f41d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1333 microversion: 2.20 time: 0.096790 Sep 03 01:38:40.132584 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 442/853] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:40 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1333 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:38:40.515386 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:40.516836 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:40.524871 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:40.531984 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:40.531984 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:40.531984 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:40.531984 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:40.532463 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:40.536425 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:40.578199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:40.578199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:40.578199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:40.578822 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lazy-loading 'fault' on Instance uuid 615f8d7e-2e14-4015-a24f-2b02e885ef44 {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:38:40.651036 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:40.659073 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ed7784f4-d68a-4426-8c3c-e15a05d6a3e0 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 200 len: 1312 microversion: 2.1 time: 0.148666 Sep 03 01:38:40.659721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 443/854] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:40 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:40.694081 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Flavor limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:38:40.697717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Image limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:38:40.697717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Flavor pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:38:40.697717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Image pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:38:40.697717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:38:40.705174 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:40.705655 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:40.706091 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:40.706858 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:40.707312 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:40.707739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:40.726522 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Getting quotas for project efb12fa605334996a0e25888c90a108a. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:38:40.730692 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Getting quotas for user 69028bf5296541b6bfe9595d684c6567 and project efb12fa605334996a0e25888c90a108a. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:38:40.742329 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Going to run 1 instances... {{(pid=127553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:38:40.744809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:38:40.815008 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7e462da2-d35a-4ad5-96e3-92863ce31b78 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:40.815628 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7e462da2-d35a-4ad5-96e3-92863ce31b78 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:40.822606 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e462da2-d35a-4ad5-96e3-92863ce31b78 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:40.823213 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e462da2-d35a-4ad5-96e3-92863ce31b78 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:40.823907 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e462da2-d35a-4ad5-96e3-92863ce31b78 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:40.824970 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e462da2-d35a-4ad5-96e3-92863ce31b78 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:40.825532 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e462da2-d35a-4ad5-96e3-92863ce31b78 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:40.826053 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e462da2-d35a-4ad5-96e3-92863ce31b78 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:40.842386 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-7e462da2-d35a-4ad5-96e3-92863ce31b78 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] HTTP exception thrown: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7e462da2-d35a-4ad5-96e3-92863ce31b78 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Request method failure captured: Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f HTTP/1.1 Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7Wua9M8FNfKrIFZ0-WQPUJXfLRBZqXcHwy-Q3Wu16LCvbiEdSxvcWC5PxoaIuhHJ4tIyi5pkH76o-vxO929lRiI3JFjjdJ6zDldYhLE7t79CHFseQWQyf33DaTLD_Mdl-CjYL8DSGor2tNh__MkSD8J686LSZDTLk8zuckFVSCMcA Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 53cde5b369084772897d46c38b083d8f Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:38:40.844200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:38:40.845868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_53cde5b369084772897d46c38b083d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/53cde5b369084772897d46c38b083d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53cde5b369084772897d46c38b083d8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53cde5b369084772897d46c38b083d8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:38:40.845868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:38:40.845868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 53cde5b369084772897d46c38b083d8f Sep 03 01:38:40.845868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:38:40.845868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-AttachVolumeTestJSON-419470651-project Sep 03 01:38:40.845868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:38:40.845868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:38:40.845868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: ecf076dde874415aa734644f27a10b4b Sep 03 01:38:40.845868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-AttachVolumeTestJSON-419470651-project Sep 03 01:38:40.845868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:38:40.845868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:38:40.845868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': 'a0fef20f-3dfd-4d65-b5ed-50f3caaa011f'} Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:38:40.852785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:38:40.854420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:40.855833 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7e462da2-d35a-4ad5-96e3-92863ce31b78 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Returning 404 to user: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:38:40.855833 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7e462da2-d35a-4ad5-96e3-92863ce31b78 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 404 len: 111 microversion: 2.1 time: 0.036050 Sep 03 01:38:40.855833 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 444/855] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:40 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 01:38:40.861660 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6a529b0d-8f5b-475e-a791-88a3768ed043 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '.version_select at 0x7f6d2819c820>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:40.870759 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c7f93a80-9a6b-4d7d-9618-9ccfb7685df3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.947688 Sep 03 01:38:40.871501 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 412/856] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:38:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:38:40.906576 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ca53eb8b-e652-4ce2-a562-9adfae4805da tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:40.910195 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ca53eb8b-e652-4ce2-a562-9adfae4805da tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:40.966890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6a529b0d-8f5b-475e-a791-88a3768ed043 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1438646856" status: 202 len: 0 microversion: 2.1 time: 0.110782 Sep 03 01:38:40.966890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 445/857] 10.222.0.13 () {58 vars in 1221 bytes} [Sat Sep 3 01:38:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1438646856 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:38:40.984330 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ca53eb8b-e652-4ce2-a562-9adfae4805da tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:40.999158 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ca53eb8b-e652-4ce2-a562-9adfae4805da tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1219 microversion: 2.1 time: 0.120012 Sep 03 01:38:41.000105 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 413/858] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:40 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1219 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:41.147887 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8f12e7ce-ed2f-43e0-a0af-515441ca15d4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:41.148520 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-8f12e7ce-ed2f-43e0-a0af-515441ca15d4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:41.154533 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8f12e7ce-ed2f-43e0-a0af-515441ca15d4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:41.155058 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8f12e7ce-ed2f-43e0-a0af-515441ca15d4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:41.155555 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8f12e7ce-ed2f-43e0-a0af-515441ca15d4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:41.156236 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8f12e7ce-ed2f-43e0-a0af-515441ca15d4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:41.156680 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8f12e7ce-ed2f-43e0-a0af-515441ca15d4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:41.157102 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8f12e7ce-ed2f-43e0-a0af-515441ca15d4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:41.459266 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8f12e7ce-ed2f-43e0-a0af-515441ca15d4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:41.474794 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8f12e7ce-ed2f-43e0-a0af-515441ca15d4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:41.476236 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8f12e7ce-ed2f-43e0-a0af-515441ca15d4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:41.479034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-8f12e7ce-ed2f-43e0-a0af-515441ca15d4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1407 microversion: 2.20 time: 0.333607 Sep 03 01:38:41.479825 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 446/859] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:41 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1407 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:41.684352 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-97817ab9-8dba-492f-9bfd-28ae2bd12f43 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:41.685022 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-97817ab9-8dba-492f-9bfd-28ae2bd12f43 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: 615f8d7e-2e14-4015-a24f-2b02e885ef44] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:41.695445 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-97817ab9-8dba-492f-9bfd-28ae2bd12f43 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:41.696143 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-97817ab9-8dba-492f-9bfd-28ae2bd12f43 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:41.696356 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-97817ab9-8dba-492f-9bfd-28ae2bd12f43 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:41.698709 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-97817ab9-8dba-492f-9bfd-28ae2bd12f43 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:41.699380 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-97817ab9-8dba-492f-9bfd-28ae2bd12f43 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:41.700046 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-97817ab9-8dba-492f-9bfd-28ae2bd12f43 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:41.705048 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:41.715361 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-97817ab9-8dba-492f-9bfd-28ae2bd12f43 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] HTTP exception thrown: Instance 615f8d7e-2e14-4015-a24f-2b02e885ef44 could not be found. Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-97817ab9-8dba-492f-9bfd-28ae2bd12f43 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Request method failure captured: Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 HTTP/1.1 Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7V2ath9gf-whD6tL86b1S7pYvql4QgUyJF1yPAVzgiQ2t6IoM2RYz54SA6JROlCBu6uMndk0hzOd9Xac4ZVRZsWa_GZPp5YK22x3_vfwipYUfM5-C8aj-iUUgX169mfrwWeU8PgX6mea_qND-4fnQAWZMLQqNrq4pPhzc49V3gV8w Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: d93c5a3ef20c4a5b87af4803f820b60e Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:38:41.717484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:38:41.718950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:38:41.718950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:38:41.718950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: d93c5a3ef20c4a5b87af4803f820b60e Sep 03 01:38:41.718950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:38:41.718950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-ServerRescueNegativeTestJSON-201019967-project Sep 03 01:38:41.718950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:38:41.718950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:38:41.718950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 409c324dca974d9dad9529b2a0d82b30 Sep 03 01:38:41.718950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201019967-project Sep 03 01:38:41.718950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:38:41.718950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 615f8d7e-2e14-4015-a24f-2b02e885ef44 could not be found. Sep 03 01:38:41.718950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '615f8d7e-2e14-4015-a24f-2b02e885ef44'} Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 615f8d7e-2e14-4015-a24f-2b02e885ef44 could not be found. Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:38:41.719718 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 615f8d7e-2e14-4015-a24f-2b02e885ef44 could not be found. Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 615f8d7e-2e14-4015-a24f-2b02e885ef44 could not be found. Sep 03 01:38:41.721059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:38:41.723557 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-97817ab9-8dba-492f-9bfd-28ae2bd12f43 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Returning 404 to user: Instance 615f8d7e-2e14-4015-a24f-2b02e885ef44 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:38:41.724743 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-97817ab9-8dba-492f-9bfd-28ae2bd12f43 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44" status: 404 len: 111 microversion: 2.1 time: 0.045294 Sep 03 01:38:41.725401 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 414/860] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:41 2022] GET /compute/v2.1/servers/615f8d7e-2e14-4015-a24f-2b02e885ef44 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:38:41.733664 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-23862f51-7ce7-4e60-a998-63f2f3963776 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:41.734152 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-23862f51-7ce7-4e60-a998-63f2f3963776 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:41.740965 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-23862f51-7ce7-4e60-a998-63f2f3963776 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:41.741763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-23862f51-7ce7-4e60-a998-63f2f3963776 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:41.742191 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-23862f51-7ce7-4e60-a998-63f2f3963776 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:41.743067 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-23862f51-7ce7-4e60-a998-63f2f3963776 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:41.743721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-23862f51-7ce7-4e60-a998-63f2f3963776 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:41.744155 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-23862f51-7ce7-4e60-a998-63f2f3963776 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:41.769596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-23862f51-7ce7-4e60-a998-63f2f3963776 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Going to try to terminate instance {{(pid=127552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:38:41.957345 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2c6d5c9d-9448-4b5e-adaf-afda2801d483 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Action: 'create', calling method: .version_select at 0x7f6d247d7940>, body: {"keypair": {"name": "tempest-keypair-273682236", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNI5msCUgeyuSvjm62EDNamJaQ4EEv72nJ0meCFiOKjPCC4nrVZpHnWdkh0H0fDLgTH51D62c27xXAuwWwIc2lKEDYhPuLgFIeTCD13Q3WVUb3apHj5gNn/2nyVv9zJVCg=="}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:41.977082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-2c6d5c9d-9448-4b5e-adaf-afda2801d483 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Getting quotas for project 53cde5b369084772897d46c38b083d8f. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:38:41.981425 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-2c6d5c9d-9448-4b5e-adaf-afda2801d483 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Getting quotas for user ecf076dde874415aa734644f27a10b4b and project 53cde5b369084772897d46c38b083d8f. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:38:42.075466 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2c6d5c9d-9448-4b5e-adaf-afda2801d483 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.121779 Sep 03 01:38:42.082522 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 415/861] 10.222.0.13 () {60 vars in 1159 bytes} [Sat Sep 3 01:38:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:42.082522 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-799eb37b-3339-4f9d-af09-d33802c15b36 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:42.082522 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-799eb37b-3339-4f9d-af09-d33802c15b36 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:42.090326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-799eb37b-3339-4f9d-af09-d33802c15b36 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:42.091063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-799eb37b-3339-4f9d-af09-d33802c15b36 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:42.091743 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-799eb37b-3339-4f9d-af09-d33802c15b36 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:42.092831 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-799eb37b-3339-4f9d-af09-d33802c15b36 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:42.093409 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-799eb37b-3339-4f9d-af09-d33802c15b36 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:42.094045 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-799eb37b-3339-4f9d-af09-d33802c15b36 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:42.118370 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-23862f51-7ce7-4e60-a998-63f2f3963776 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 204 len: 0 microversion: 2.1 time: 0.388454 Sep 03 01:38:42.119310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 447/862] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:38:41 2022] DELETE /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:38:42.129961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-276dfeac-46a2-4aba-910f-d65526d03399 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:42.131757 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-276dfeac-46a2-4aba-910f-d65526d03399 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:42.143300 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-276dfeac-46a2-4aba-910f-d65526d03399 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:42.147225 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-276dfeac-46a2-4aba-910f-d65526d03399 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:42.155283 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-276dfeac-46a2-4aba-910f-d65526d03399 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:42.156080 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-276dfeac-46a2-4aba-910f-d65526d03399 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:42.156560 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-276dfeac-46a2-4aba-910f-d65526d03399 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:42.156997 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-276dfeac-46a2-4aba-910f-d65526d03399 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:42.185992 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-799eb37b-3339-4f9d-af09-d33802c15b36 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:42.196467 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-799eb37b-3339-4f9d-af09-d33802c15b36 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1223 microversion: 2.1 time: 0.118974 Sep 03 01:38:42.201780 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 416/863] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:42 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1223 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:42.314354 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-276dfeac-46a2-4aba-910f-d65526d03399 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:42.322847 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-276dfeac-46a2-4aba-910f-d65526d03399 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.199288 Sep 03 01:38:42.323425 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 448/864] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:42 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:42.360729 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-c397a63b-b8db-481d-8ae5-0c6d58f7f209 req-d86c2e9e-23f6-44b1-ab0e-50927ec5275a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e156f97d-5465-4597-a836-c70692edfd41", "tag": "b4585caf-c260-4618-ba71-326b4c35ffdf"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:42.371754 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-c397a63b-b8db-481d-8ae5-0c6d58f7f209 req-d86c2e9e-23f6-44b1-ab0e-50927ec5275a service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:42.372293 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-c397a63b-b8db-481d-8ae5-0c6d58f7f209 req-d86c2e9e-23f6-44b1-ab0e-50927ec5275a service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:42.372667 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-c397a63b-b8db-481d-8ae5-0c6d58f7f209 req-d86c2e9e-23f6-44b1-ab0e-50927ec5275a service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:42.384416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-c397a63b-b8db-481d-8ae5-0c6d58f7f209 req-d86c2e9e-23f6-44b1-ab0e-50927ec5275a service nova] Creating event network-changed:b4585caf-c260-4618-ba71-326b4c35ffdf for instance e156f97d-5465-4597-a836-c70692edfd41 on hv-cinder-83800 Sep 03 01:38:42.389214 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-c397a63b-b8db-481d-8ae5-0c6d58f7f209 req-d86c2e9e-23f6-44b1-ab0e-50927ec5275a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033067 Sep 03 01:38:42.389808 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 417/865] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:42.509666 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3449c31f-3704-4622-9e9d-41a62d4d5a1e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:42.510421 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-3449c31f-3704-4622-9e9d-41a62d4d5a1e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:42.516443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3449c31f-3704-4622-9e9d-41a62d4d5a1e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:42.516998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3449c31f-3704-4622-9e9d-41a62d4d5a1e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:42.517508 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3449c31f-3704-4622-9e9d-41a62d4d5a1e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:42.518257 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3449c31f-3704-4622-9e9d-41a62d4d5a1e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:42.518830 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3449c31f-3704-4622-9e9d-41a62d4d5a1e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:42.519321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3449c31f-3704-4622-9e9d-41a62d4d5a1e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:42.653450 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3449c31f-3704-4622-9e9d-41a62d4d5a1e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:42.662948 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3449c31f-3704-4622-9e9d-41a62d4d5a1e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:42.664398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3449c31f-3704-4622-9e9d-41a62d4d5a1e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:42.665504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3449c31f-3704-4622-9e9d-41a62d4d5a1e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1407 microversion: 2.20 time: 0.160426 Sep 03 01:38:42.666060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 449/866] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:42 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:43.221706 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-eb05f020-eb65-4e06-9382-5c8f007e8c3e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:43.222652 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-eb05f020-eb65-4e06-9382-5c8f007e8c3e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:43.228997 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eb05f020-eb65-4e06-9382-5c8f007e8c3e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:43.229478 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eb05f020-eb65-4e06-9382-5c8f007e8c3e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:43.229908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eb05f020-eb65-4e06-9382-5c8f007e8c3e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:43.230618 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eb05f020-eb65-4e06-9382-5c8f007e8c3e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:43.231069 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eb05f020-eb65-4e06-9382-5c8f007e8c3e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:43.231488 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-eb05f020-eb65-4e06-9382-5c8f007e8c3e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:43.306766 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-eb05f020-eb65-4e06-9382-5c8f007e8c3e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:43.314261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-eb05f020-eb65-4e06-9382-5c8f007e8c3e tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1215 microversion: 2.1 time: 0.097702 Sep 03 01:38:43.314866 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 418/867] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:43 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1215 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:43.345430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2ab158c9-e92f-4891-a7e1-e54048c46e54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:43.346095 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2ab158c9-e92f-4891-a7e1-e54048c46e54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:43.348512 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:43.349862 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=6 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:43.354656 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2ab158c9-e92f-4891-a7e1-e54048c46e54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:43.355148 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2ab158c9-e92f-4891-a7e1-e54048c46e54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:43.359800 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2ab158c9-e92f-4891-a7e1-e54048c46e54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:43.359800 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2ab158c9-e92f-4891-a7e1-e54048c46e54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:43.359800 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2ab158c9-e92f-4891-a7e1-e54048c46e54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:43.359800 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2ab158c9-e92f-4891-a7e1-e54048c46e54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:43.499554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2ab158c9-e92f-4891-a7e1-e54048c46e54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:43.507335 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2ab158c9-e92f-4891-a7e1-e54048c46e54 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.165733 Sep 03 01:38:43.507914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 450/868] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:43 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:43.691608 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-3e0ee199-c0a8-409d-9ab5-0c8f745e3850 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:43.692281 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-3e0ee199-c0a8-409d-9ab5-0c8f745e3850 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:43.698418 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e0ee199-c0a8-409d-9ab5-0c8f745e3850 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:43.698911 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e0ee199-c0a8-409d-9ab5-0c8f745e3850 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:43.699344 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e0ee199-c0a8-409d-9ab5-0c8f745e3850 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:43.700032 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e0ee199-c0a8-409d-9ab5-0c8f745e3850 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:43.700476 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e0ee199-c0a8-409d-9ab5-0c8f745e3850 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:43.700895 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3e0ee199-c0a8-409d-9ab5-0c8f745e3850 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:43.860920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-3e0ee199-c0a8-409d-9ab5-0c8f745e3850 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:43.869858 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-3e0ee199-c0a8-409d-9ab5-0c8f745e3850 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:43.871462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-3e0ee199-c0a8-409d-9ab5-0c8f745e3850 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:43.872657 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-3e0ee199-c0a8-409d-9ab5-0c8f745e3850 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1407 microversion: 2.20 time: 0.185098 Sep 03 01:38:43.873508 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 419/869] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:43 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:44.262439 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-904802882", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3699488b-c45e-45e8-a057-bbc9d098a735"}], "security_groups": [{"name": "tempest-securitygroup--345530974"}], "key_name": "tempest-keypair-273682236", "user_data": "}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:44.338605 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0b2eba87-b2e9-41ed-a450-565f046d5551 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:44.339213 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-0b2eba87-b2e9-41ed-a450-565f046d5551 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:44.345616 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b2eba87-b2e9-41ed-a450-565f046d5551 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:44.346097 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b2eba87-b2e9-41ed-a450-565f046d5551 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:44.346564 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b2eba87-b2e9-41ed-a450-565f046d5551 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:44.347287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b2eba87-b2e9-41ed-a450-565f046d5551 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:44.347739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b2eba87-b2e9-41ed-a450-565f046d5551 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:44.348164 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b2eba87-b2e9-41ed-a450-565f046d5551 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:44.369356 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.network.neutron [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] validate_networks() for [('3699488b-c45e-45e8-a057-bbc9d098a735', None, None, None, None, None)] {{(pid=127552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:38:44.411266 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-0b2eba87-b2e9-41ed-a450-565f046d5551 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:44.420087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0b2eba87-b2e9-41ed-a450-565f046d5551 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1215 microversion: 2.1 time: 0.085524 Sep 03 01:38:44.420666 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 420/870] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:44 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:44.530407 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a5140e20-b612-42f0-80a3-9da85021dbd1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:44.531041 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a5140e20-b612-42f0-80a3-9da85021dbd1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:44.537979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a5140e20-b612-42f0-80a3-9da85021dbd1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:44.538495 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a5140e20-b612-42f0-80a3-9da85021dbd1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:44.539015 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a5140e20-b612-42f0-80a3-9da85021dbd1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:44.539694 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a5140e20-b612-42f0-80a3-9da85021dbd1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:44.540208 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a5140e20-b612-42f0-80a3-9da85021dbd1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:44.540634 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a5140e20-b612-42f0-80a3-9da85021dbd1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:44.675919 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a5140e20-b612-42f0-80a3-9da85021dbd1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:44.683753 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a5140e20-b612-42f0-80a3-9da85021dbd1 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.157297 Sep 03 01:38:44.684327 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 421/871] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:44 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:44.773223 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Flavor limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:38:44.773642 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Image limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:38:44.774106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Flavor pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:38:44.774544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Image pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:38:44.774950 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:38:44.784058 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:44.784530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:44.784957 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:44.785675 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:44.786124 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:44.787204 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:44.804120 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Getting quotas for project 53cde5b369084772897d46c38b083d8f. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:38:44.808893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Getting quotas for user ecf076dde874415aa734644f27a10b4b and project 53cde5b369084772897d46c38b083d8f. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:38:44.820735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Going to run 1 instances... {{(pid=127552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:38:44.823106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:38:44.903305 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-621175be-376d-46d0-a6dc-e6bd837d3948 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:44.903864 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-621175be-376d-46d0-a6dc-e6bd837d3948 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:44.910148 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-621175be-376d-46d0-a6dc-e6bd837d3948 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:44.910682 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-621175be-376d-46d0-a6dc-e6bd837d3948 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:44.911099 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-621175be-376d-46d0-a6dc-e6bd837d3948 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:44.911815 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-621175be-376d-46d0-a6dc-e6bd837d3948 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:44.912303 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-621175be-376d-46d0-a6dc-e6bd837d3948 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:44.912681 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-621175be-376d-46d0-a6dc-e6bd837d3948 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:44.976024 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-de9ccdee-dbb1-46df-9f0b-64aa7ca3e702 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.718929 Sep 03 01:38:44.978894 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 451/872] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:38:44 2022] POST /compute/v2.1/servers => generated 401 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:38:44.996005 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-98d41ddc-9845-4a59-8308-fb94e3467999 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:44.996005 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-98d41ddc-9845-4a59-8308-fb94e3467999 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:45.089946 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-621175be-376d-46d0-a6dc-e6bd837d3948 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:45.100088 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-621175be-376d-46d0-a6dc-e6bd837d3948 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:45.102096 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-621175be-376d-46d0-a6dc-e6bd837d3948 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:45.105183 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-621175be-376d-46d0-a6dc-e6bd837d3948 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1407 microversion: 2.20 time: 0.204219 Sep 03 01:38:45.106497 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 422/873] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:44 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1407 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:38:45.363456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-98d41ddc-9845-4a59-8308-fb94e3467999 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:45.372144 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-98d41ddc-9845-4a59-8308-fb94e3467999 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1236 microversion: 2.1 time: 0.385598 Sep 03 01:38:45.373813 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 452/874] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:44 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1236 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:45.444338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-63e73152-7cdb-4209-86b8-fea6fce8b0dc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:45.445039 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-63e73152-7cdb-4209-86b8-fea6fce8b0dc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:45.451600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e73152-7cdb-4209-86b8-fea6fce8b0dc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:45.452303 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e73152-7cdb-4209-86b8-fea6fce8b0dc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:45.452857 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e73152-7cdb-4209-86b8-fea6fce8b0dc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:45.453734 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e73152-7cdb-4209-86b8-fea6fce8b0dc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:45.454283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e73152-7cdb-4209-86b8-fea6fce8b0dc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:45.454797 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e73152-7cdb-4209-86b8-fea6fce8b0dc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:45.517209 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-63e73152-7cdb-4209-86b8-fea6fce8b0dc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:45.524853 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-63e73152-7cdb-4209-86b8-fea6fce8b0dc tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1271 microversion: 2.1 time: 0.085134 Sep 03 01:38:45.525411 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 423/875] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:45 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:45.707236 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0402a16c-d050-411d-9e19-15eb324cbe9e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:45.707871 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0402a16c-d050-411d-9e19-15eb324cbe9e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:45.714699 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0402a16c-d050-411d-9e19-15eb324cbe9e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:45.715181 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0402a16c-d050-411d-9e19-15eb324cbe9e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:45.715616 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0402a16c-d050-411d-9e19-15eb324cbe9e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:45.716314 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0402a16c-d050-411d-9e19-15eb324cbe9e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:45.716766 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0402a16c-d050-411d-9e19-15eb324cbe9e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:45.717184 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0402a16c-d050-411d-9e19-15eb324cbe9e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:46.041595 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0402a16c-d050-411d-9e19-15eb324cbe9e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:46.049705 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0402a16c-d050-411d-9e19-15eb324cbe9e tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1521 microversion: 2.1 time: 0.346337 Sep 03 01:38:46.050360 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 453/876] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:45 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:46.134153 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-35bc7764-8f46-45c6-ac3b-16b9969b737f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:46.134921 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-35bc7764-8f46-45c6-ac3b-16b9969b737f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:46.141669 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-35bc7764-8f46-45c6-ac3b-16b9969b737f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:46.142149 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-35bc7764-8f46-45c6-ac3b-16b9969b737f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:46.142615 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-35bc7764-8f46-45c6-ac3b-16b9969b737f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:46.143306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-35bc7764-8f46-45c6-ac3b-16b9969b737f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:46.143795 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-35bc7764-8f46-45c6-ac3b-16b9969b737f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:46.144215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-35bc7764-8f46-45c6-ac3b-16b9969b737f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:46.337230 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-35bc7764-8f46-45c6-ac3b-16b9969b737f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:46.346589 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-35bc7764-8f46-45c6-ac3b-16b9969b737f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:46.348026 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-35bc7764-8f46-45c6-ac3b-16b9969b737f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:46.350302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-35bc7764-8f46-45c6-ac3b-16b9969b737f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1407 microversion: 2.20 time: 0.219668 Sep 03 01:38:46.351101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 424/877] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:46 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1407 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:46.397515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-55aacc4b-fa68-4dfa-a605-59c1569dcc4d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:46.401141 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-55aacc4b-fa68-4dfa-a605-59c1569dcc4d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:46.406777 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55aacc4b-fa68-4dfa-a605-59c1569dcc4d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:46.407846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55aacc4b-fa68-4dfa-a605-59c1569dcc4d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:46.408555 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55aacc4b-fa68-4dfa-a605-59c1569dcc4d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:46.409520 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55aacc4b-fa68-4dfa-a605-59c1569dcc4d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:46.410142 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55aacc4b-fa68-4dfa-a605-59c1569dcc4d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:46.410699 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55aacc4b-fa68-4dfa-a605-59c1569dcc4d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:46.428703 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-28c2f26e-355f-4722-86de-0635651b496b req-49930d25-ab53-446e-83ae-f3626a19d712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dea4f761-54b0-4e77-9d84-5143f79c4e8a", "name": "network-vif-deleted", "tag": "e5fef679-f9d4-4ff4-99a4-3e18be20bd06"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:46.438757 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-28c2f26e-355f-4722-86de-0635651b496b req-49930d25-ab53-446e-83ae-f3626a19d712 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:46.439508 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-28c2f26e-355f-4722-86de-0635651b496b req-49930d25-ab53-446e-83ae-f3626a19d712 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:46.440304 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-28c2f26e-355f-4722-86de-0635651b496b req-49930d25-ab53-446e-83ae-f3626a19d712 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:46.473324 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-28c2f26e-355f-4722-86de-0635651b496b req-49930d25-ab53-446e-83ae-f3626a19d712 service nova] Creating event network-vif-deleted:e5fef679-f9d4-4ff4-99a4-3e18be20bd06 for instance dea4f761-54b0-4e77-9d84-5143f79c4e8a on hv-cinder-83800 Sep 03 01:38:46.480452 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-28c2f26e-355f-4722-86de-0635651b496b req-49930d25-ab53-446e-83ae-f3626a19d712 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055731 Sep 03 01:38:46.481732 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 425/878] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:38:46.492572 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-55aacc4b-fa68-4dfa-a605-59c1569dcc4d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:46.500695 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-55aacc4b-fa68-4dfa-a605-59c1569dcc4d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1232 microversion: 2.1 time: 0.107858 Sep 03 01:38:46.510534 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 454/879] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:46 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1232 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:46.549240 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-540a356f-b02b-4854-b6d3-01fabae92fdb tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:46.549999 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-540a356f-b02b-4854-b6d3-01fabae92fdb tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:46.563539 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-540a356f-b02b-4854-b6d3-01fabae92fdb tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:46.564139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-540a356f-b02b-4854-b6d3-01fabae92fdb tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:46.564643 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-540a356f-b02b-4854-b6d3-01fabae92fdb tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:46.565406 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-540a356f-b02b-4854-b6d3-01fabae92fdb tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:46.565924 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-540a356f-b02b-4854-b6d3-01fabae92fdb tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:46.566433 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-540a356f-b02b-4854-b6d3-01fabae92fdb tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:46.787253 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-540a356f-b02b-4854-b6d3-01fabae92fdb tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:46.794909 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-540a356f-b02b-4854-b6d3-01fabae92fdb tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1319 microversion: 2.1 time: 0.249871 Sep 03 01:38:46.800597 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 426/880] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:46 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:47.072791 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-82aae1ce-a832-4e51-b482-7126502563c8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:47.073400 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-82aae1ce-a832-4e51-b482-7126502563c8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:47.079351 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-82aae1ce-a832-4e51-b482-7126502563c8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:47.081189 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-82aae1ce-a832-4e51-b482-7126502563c8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:47.081189 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-82aae1ce-a832-4e51-b482-7126502563c8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:47.081189 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-82aae1ce-a832-4e51-b482-7126502563c8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:47.081498 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-82aae1ce-a832-4e51-b482-7126502563c8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:47.081780 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-82aae1ce-a832-4e51-b482-7126502563c8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:47.145601 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-82aae1ce-a832-4e51-b482-7126502563c8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:47.153762 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-82aae1ce-a832-4e51-b482-7126502563c8 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1479 microversion: 2.1 time: 0.084947 Sep 03 01:38:47.154354 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 455/881] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:47 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1479 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:47.377020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-81a81ce8-e171-413a-8936-2168363e8a1a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:47.377772 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-81a81ce8-e171-413a-8936-2168363e8a1a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:47.383953 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81a81ce8-e171-413a-8936-2168363e8a1a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:47.389122 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81a81ce8-e171-413a-8936-2168363e8a1a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:47.389122 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81a81ce8-e171-413a-8936-2168363e8a1a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:47.389122 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81a81ce8-e171-413a-8936-2168363e8a1a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:47.389122 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81a81ce8-e171-413a-8936-2168363e8a1a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:47.389522 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-81a81ce8-e171-413a-8936-2168363e8a1a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:47.525335 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d6e04099-d8ec-4101-94a5-d9791ca32b5d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:47.526829 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d6e04099-d8ec-4101-94a5-d9791ca32b5d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:47.533839 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d6e04099-d8ec-4101-94a5-d9791ca32b5d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:47.534665 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d6e04099-d8ec-4101-94a5-d9791ca32b5d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:47.535330 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d6e04099-d8ec-4101-94a5-d9791ca32b5d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:47.536119 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d6e04099-d8ec-4101-94a5-d9791ca32b5d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:47.536856 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d6e04099-d8ec-4101-94a5-d9791ca32b5d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:47.537353 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d6e04099-d8ec-4101-94a5-d9791ca32b5d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:47.607705 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d6e04099-d8ec-4101-94a5-d9791ca32b5d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:47.616917 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d6e04099-d8ec-4101-94a5-d9791ca32b5d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1288 microversion: 2.1 time: 0.095620 Sep 03 01:38:47.617740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 456/882] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:47 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1288 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:47.640323 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-81a81ce8-e171-413a-8936-2168363e8a1a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:47.651128 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-81a81ce8-e171-413a-8936-2168363e8a1a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:47.654719 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-81a81ce8-e171-413a-8936-2168363e8a1a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:47.658150 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-81a81ce8-e171-413a-8936-2168363e8a1a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1407 microversion: 2.20 time: 0.284592 Sep 03 01:38:47.660336 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 427/883] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:47 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:47.818227 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6fe75986-cfda-406f-b282-028176bd30aa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:47.819418 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6fe75986-cfda-406f-b282-028176bd30aa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:47.826332 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6fe75986-cfda-406f-b282-028176bd30aa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:47.827058 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6fe75986-cfda-406f-b282-028176bd30aa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:47.827504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6fe75986-cfda-406f-b282-028176bd30aa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:47.828848 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6fe75986-cfda-406f-b282-028176bd30aa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:47.829315 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6fe75986-cfda-406f-b282-028176bd30aa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:47.829773 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6fe75986-cfda-406f-b282-028176bd30aa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:48.010298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6fe75986-cfda-406f-b282-028176bd30aa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:48.018458 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6fe75986-cfda-406f-b282-028176bd30aa tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1319 microversion: 2.1 time: 0.204711 Sep 03 01:38:48.019045 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 457/884] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:47 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:48.177549 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:48.178881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:48.187576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:48.190326 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:48.191742 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:48.193252 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:48.198302 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:48.198801 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:48.205741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-f1984b86-160c-4bee-928a-50c60c08a5d8 req-7147856d-8ae1-4b7f-88c7-47f98f46f9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b38d9e1-6eef-468f-82e1-a96d8d28214c", "tag": "768a2c50-eeb8-48ba-885e-1eab0487f58f"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:48.215593 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-f1984b86-160c-4bee-928a-50c60c08a5d8 req-7147856d-8ae1-4b7f-88c7-47f98f46f9b6 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:48.216148 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-f1984b86-160c-4bee-928a-50c60c08a5d8 req-7147856d-8ae1-4b7f-88c7-47f98f46f9b6 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:48.216582 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-f1984b86-160c-4bee-928a-50c60c08a5d8 req-7147856d-8ae1-4b7f-88c7-47f98f46f9b6 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:48.228160 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:48.229264 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-f1984b86-160c-4bee-928a-50c60c08a5d8 req-7147856d-8ae1-4b7f-88c7-47f98f46f9b6 service nova] Creating event network-changed:768a2c50-eeb8-48ba-885e-1eab0487f58f for instance 6b38d9e1-6eef-468f-82e1-a96d8d28214c on hv-cinder-83800 Sep 03 01:38:48.231751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:48.232237 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:48.232670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:48.233114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lazy-loading 'fault' on Instance uuid dea4f761-54b0-4e77-9d84-5143f79c4e8a {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:38:48.234410 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-f1984b86-160c-4bee-928a-50c60c08a5d8 req-7147856d-8ae1-4b7f-88c7-47f98f46f9b6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101492 Sep 03 01:38:48.235040 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 428/885] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:48.276481 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '409c324dca974d9dad9529b2a0d82b30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd93c5a3ef20c4a5b87af4803f820b60e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:48.284469 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-55e6ebdc-0798-45a9-b1f6-887f5b99ad2d tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 200 len: 1312 microversion: 2.1 time: 0.111306 Sep 03 01:38:48.285033 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 458/886] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:48 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 1312 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:48.641311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ae129cba-c1b9-4af7-9c4c-1d81ab6e7658 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:48.642014 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ae129cba-c1b9-4af7-9c4c-1d81ab6e7658 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:48.649359 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae129cba-c1b9-4af7-9c4c-1d81ab6e7658 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:48.649838 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae129cba-c1b9-4af7-9c4c-1d81ab6e7658 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:48.650271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae129cba-c1b9-4af7-9c4c-1d81ab6e7658 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:48.650997 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae129cba-c1b9-4af7-9c4c-1d81ab6e7658 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:48.651454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae129cba-c1b9-4af7-9c4c-1d81ab6e7658 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:48.651879 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ae129cba-c1b9-4af7-9c4c-1d81ab6e7658 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:48.684141 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3edee68a-0b0c-4327-8b03-395337201198 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:48.684739 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-3edee68a-0b0c-4327-8b03-395337201198 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:48.691708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3edee68a-0b0c-4327-8b03-395337201198 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:48.692265 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3edee68a-0b0c-4327-8b03-395337201198 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:48.693304 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3edee68a-0b0c-4327-8b03-395337201198 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:48.694223 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3edee68a-0b0c-4327-8b03-395337201198 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:48.694779 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3edee68a-0b0c-4327-8b03-395337201198 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:48.695267 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3edee68a-0b0c-4327-8b03-395337201198 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:48.758630 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ae129cba-c1b9-4af7-9c4c-1d81ab6e7658 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:48.767267 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ae129cba-c1b9-4af7-9c4c-1d81ab6e7658 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1306 microversion: 2.1 time: 0.130249 Sep 03 01:38:48.768356 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 429/887] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:48 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1306 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:48.873739 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3edee68a-0b0c-4327-8b03-395337201198 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:48.882952 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3edee68a-0b0c-4327-8b03-395337201198 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:48.886826 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3edee68a-0b0c-4327-8b03-395337201198 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:48.886826 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3edee68a-0b0c-4327-8b03-395337201198 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1407 microversion: 2.20 time: 0.205334 Sep 03 01:38:48.886826 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 459/888] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:48 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:38:49.041567 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-93556ea4-e9aa-4853-b008-51c2fe644a7b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:49.042188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-93556ea4-e9aa-4853-b008-51c2fe644a7b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:49.048427 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93556ea4-e9aa-4853-b008-51c2fe644a7b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:49.049174 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93556ea4-e9aa-4853-b008-51c2fe644a7b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:49.049620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93556ea4-e9aa-4853-b008-51c2fe644a7b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:49.050350 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93556ea4-e9aa-4853-b008-51c2fe644a7b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:49.050846 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93556ea4-e9aa-4853-b008-51c2fe644a7b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:49.051276 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93556ea4-e9aa-4853-b008-51c2fe644a7b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:49.272490 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-93556ea4-e9aa-4853-b008-51c2fe644a7b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:49.281525 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-93556ea4-e9aa-4853-b008-51c2fe644a7b tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1319 microversion: 2.1 time: 0.243748 Sep 03 01:38:49.286110 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 430/889] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:49 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:49.308715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e8d8b36e-e31b-44fe-92bc-f24dfec39fa3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:49.309327 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e8d8b36e-e31b-44fe-92bc-f24dfec39fa3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] [instance: dea4f761-54b0-4e77-9d84-5143f79c4e8a] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:49.315451 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e8d8b36e-e31b-44fe-92bc-f24dfec39fa3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:49.315935 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e8d8b36e-e31b-44fe-92bc-f24dfec39fa3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:49.316369 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e8d8b36e-e31b-44fe-92bc-f24dfec39fa3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:49.317056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e8d8b36e-e31b-44fe-92bc-f24dfec39fa3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:49.317507 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e8d8b36e-e31b-44fe-92bc-f24dfec39fa3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:49.318011 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e8d8b36e-e31b-44fe-92bc-f24dfec39fa3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:49.331310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-e8d8b36e-e31b-44fe-92bc-f24dfec39fa3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] HTTP exception thrown: Instance dea4f761-54b0-4e77-9d84-5143f79c4e8a could not be found. Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e8d8b36e-e31b-44fe-92bc-f24dfec39fa3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Request method failure captured: Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a HTTP/1.1 Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7V2ath9gf-whD6tL86b1S7pYvql4QgUyJF1yPAVzgiQ2t6IoM2RYz54SA6JROlCBu6uMndk0hzOd9Xac4ZVRZsWa_GZPp5YK22x3_vfwipYUfM5-C8aj-iUUgX169mfrwWeU8PgX6mea_qND-4fnQAWZMLQqNrq4pPhzc49V3gV8w Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: d93c5a3ef20c4a5b87af4803f820b60e Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:38:49.332937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:38:49.337865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d93c5a3ef20c4a5b87af4803f820b60e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:38:49.337865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:38:49.337865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: d93c5a3ef20c4a5b87af4803f820b60e Sep 03 01:38:49.337865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201019967 Sep 03 01:38:49.337865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-ServerRescueNegativeTestJSON-201019967-project Sep 03 01:38:49.337865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:38:49.337865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:38:49.337865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 409c324dca974d9dad9529b2a0d82b30 Sep 03 01:38:49.337865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201019967-project Sep 03 01:38:49.337865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:38:49.337865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance dea4f761-54b0-4e77-9d84-5143f79c4e8a could not be found. Sep 03 01:38:49.337865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': 'dea4f761-54b0-4e77-9d84-5143f79c4e8a'} Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dea4f761-54b0-4e77-9d84-5143f79c4e8a could not be found. Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:38:49.338882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dea4f761-54b0-4e77-9d84-5143f79c4e8a could not be found. Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dea4f761-54b0-4e77-9d84-5143f79c4e8a could not be found. Sep 03 01:38:49.340554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:38:49.341849 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e8d8b36e-e31b-44fe-92bc-f24dfec39fa3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] Returning 404 to user: Instance dea4f761-54b0-4e77-9d84-5143f79c4e8a could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:38:49.341849 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e8d8b36e-e31b-44fe-92bc-f24dfec39fa3 tempest-ServerRescueNegativeTestJSON-201019967 tempest-ServerRescueNegativeTestJSON-201019967-project] 10.222.0.13 "GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a" status: 404 len: 111 microversion: 2.1 time: 0.029902 Sep 03 01:38:49.341849 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 460/890] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:49 2022] GET /compute/v2.1/servers/dea4f761-54b0-4e77-9d84-5143f79c4e8a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:38:49.793360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b98c94a3-344e-452f-b97e-42e527b3a152 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:49.793964 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b98c94a3-344e-452f-b97e-42e527b3a152 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:49.800891 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b98c94a3-344e-452f-b97e-42e527b3a152 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:49.801462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b98c94a3-344e-452f-b97e-42e527b3a152 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:49.801925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b98c94a3-344e-452f-b97e-42e527b3a152 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:49.802667 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b98c94a3-344e-452f-b97e-42e527b3a152 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:49.803215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b98c94a3-344e-452f-b97e-42e527b3a152 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:49.803832 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b98c94a3-344e-452f-b97e-42e527b3a152 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:49.912795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-567bafe1-f0ba-4a5a-94f8-52a3fce0742f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:49.913434 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-567bafe1-f0ba-4a5a-94f8-52a3fce0742f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:49.920410 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-567bafe1-f0ba-4a5a-94f8-52a3fce0742f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:49.921963 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-567bafe1-f0ba-4a5a-94f8-52a3fce0742f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:49.921963 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-567bafe1-f0ba-4a5a-94f8-52a3fce0742f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:49.921963 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-567bafe1-f0ba-4a5a-94f8-52a3fce0742f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:49.922426 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-567bafe1-f0ba-4a5a-94f8-52a3fce0742f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:49.922839 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-567bafe1-f0ba-4a5a-94f8-52a3fce0742f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:49.942946 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:50.073112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-567bafe1-f0ba-4a5a-94f8-52a3fce0742f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:50.082028 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b98c94a3-344e-452f-b97e-42e527b3a152 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:50.088893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-567bafe1-f0ba-4a5a-94f8-52a3fce0742f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:50.095282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-567bafe1-f0ba-4a5a-94f8-52a3fce0742f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:50.095282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-567bafe1-f0ba-4a5a-94f8-52a3fce0742f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1407 microversion: 2.20 time: 0.183831 Sep 03 01:38:50.095282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 461/891] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:49 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:38:50.103192 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b98c94a3-344e-452f-b97e-42e527b3a152 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1361 microversion: 2.1 time: 0.302443 Sep 03 01:38:50.110513 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 431/892] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:49 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1361 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:50.173545 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-684054bd-4690-4758-923a-45c99d7aac9e req-a7e5859e-afd1-4f7e-af04-11ca2be887cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e156f97d-5465-4597-a836-c70692edfd41", "name": "network-vif-plugged", "status": "completed", "tag": "b4585caf-c260-4618-ba71-326b4c35ffdf"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:50.183433 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-684054bd-4690-4758-923a-45c99d7aac9e req-a7e5859e-afd1-4f7e-af04-11ca2be887cd service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:50.183919 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-684054bd-4690-4758-923a-45c99d7aac9e req-a7e5859e-afd1-4f7e-af04-11ca2be887cd service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:50.184354 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-684054bd-4690-4758-923a-45c99d7aac9e req-a7e5859e-afd1-4f7e-af04-11ca2be887cd service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:50.196139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-684054bd-4690-4758-923a-45c99d7aac9e req-a7e5859e-afd1-4f7e-af04-11ca2be887cd service nova] Creating event network-vif-plugged:b4585caf-c260-4618-ba71-326b4c35ffdf for instance e156f97d-5465-4597-a836-c70692edfd41 on hv-cinder-83800 Sep 03 01:38:50.200960 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-684054bd-4690-4758-923a-45c99d7aac9e req-a7e5859e-afd1-4f7e-af04-11ca2be887cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088781 Sep 03 01:38:50.201571 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 462/893] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:50.309312 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a78673f9-7d7a-45e4-9ae6-c757c5e7e311 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:50.310109 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a78673f9-7d7a-45e4-9ae6-c757c5e7e311 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:50.312725 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:50.319414 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a78673f9-7d7a-45e4-9ae6-c757c5e7e311 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:50.320094 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a78673f9-7d7a-45e4-9ae6-c757c5e7e311 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:50.320696 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a78673f9-7d7a-45e4-9ae6-c757c5e7e311 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:50.321672 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a78673f9-7d7a-45e4-9ae6-c757c5e7e311 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:50.322231 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a78673f9-7d7a-45e4-9ae6-c757c5e7e311 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:50.322834 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a78673f9-7d7a-45e4-9ae6-c757c5e7e311 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:50.616315 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a78673f9-7d7a-45e4-9ae6-c757c5e7e311 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:50.626038 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a78673f9-7d7a-45e4-9ae6-c757c5e7e311 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1319 microversion: 2.1 time: 0.321883 Sep 03 01:38:50.626844 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 432/894] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:50 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1319 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:51.121019 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-96df8528-ed68-444a-959a-8df7fbd517e9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:51.121692 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-96df8528-ed68-444a-959a-8df7fbd517e9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:51.126856 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-029424ef-923f-49a6-b173-1c832ae61f0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:51.127933 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-96df8528-ed68-444a-959a-8df7fbd517e9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:51.128422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-96df8528-ed68-444a-959a-8df7fbd517e9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:51.128721 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-029424ef-923f-49a6-b173-1c832ae61f0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:51.128836 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-96df8528-ed68-444a-959a-8df7fbd517e9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:51.129533 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-96df8528-ed68-444a-959a-8df7fbd517e9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:51.130010 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-96df8528-ed68-444a-959a-8df7fbd517e9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:51.130452 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-96df8528-ed68-444a-959a-8df7fbd517e9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:51.131388 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:51.137282 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-029424ef-923f-49a6-b173-1c832ae61f0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:51.137857 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-029424ef-923f-49a6-b173-1c832ae61f0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:51.138441 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-029424ef-923f-49a6-b173-1c832ae61f0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:51.139220 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-029424ef-923f-49a6-b173-1c832ae61f0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:51.139757 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-029424ef-923f-49a6-b173-1c832ae61f0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:51.140266 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-029424ef-923f-49a6-b173-1c832ae61f0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:51.288092 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-96df8528-ed68-444a-959a-8df7fbd517e9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:51.297068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-96df8528-ed68-444a-959a-8df7fbd517e9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:51.298546 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-96df8528-ed68-444a-959a-8df7fbd517e9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:51.299822 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-96df8528-ed68-444a-959a-8df7fbd517e9 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1407 microversion: 2.20 time: 0.183750 Sep 03 01:38:51.302713 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 463/895] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:51 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:51.506662 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-029424ef-923f-49a6-b173-1c832ae61f0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:51.515036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-029424ef-923f-49a6-b173-1c832ae61f0b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1361 microversion: 2.1 time: 0.391999 Sep 03 01:38:51.515625 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 433/896] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:51 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1361 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:51.650234 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2ba6c735-d321-4770-9854-bf7da76bbd3d tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:51.650897 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2ba6c735-d321-4770-9854-bf7da76bbd3d tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:51.656947 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2ba6c735-d321-4770-9854-bf7da76bbd3d tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:51.657479 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2ba6c735-d321-4770-9854-bf7da76bbd3d tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:51.658528 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2ba6c735-d321-4770-9854-bf7da76bbd3d tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:51.659281 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2ba6c735-d321-4770-9854-bf7da76bbd3d tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:51.659731 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2ba6c735-d321-4770-9854-bf7da76bbd3d tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:51.660206 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2ba6c735-d321-4770-9854-bf7da76bbd3d tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:51.681963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-1b8b26fa-1609-4c38-9735-00cd8507c084 req-feee1da2-af39-4178-a1ad-0166fb795e4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6", "tag": "032bf397-9317-48c8-8b99-bddb13c489ed"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:51.702675 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-1b8b26fa-1609-4c38-9735-00cd8507c084 req-feee1da2-af39-4178-a1ad-0166fb795e4c service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:51.703166 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-1b8b26fa-1609-4c38-9735-00cd8507c084 req-feee1da2-af39-4178-a1ad-0166fb795e4c service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:51.704031 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-1b8b26fa-1609-4c38-9735-00cd8507c084 req-feee1da2-af39-4178-a1ad-0166fb795e4c service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:51.717393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-1b8b26fa-1609-4c38-9735-00cd8507c084 req-feee1da2-af39-4178-a1ad-0166fb795e4c service nova] Creating event network-changed:032bf397-9317-48c8-8b99-bddb13c489ed for instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 on hv-cinder-83800 Sep 03 01:38:51.723174 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-1b8b26fa-1609-4c38-9735-00cd8507c084 req-feee1da2-af39-4178-a1ad-0166fb795e4c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052556 Sep 03 01:38:51.725063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 434/897] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:51.806999 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2ba6c735-d321-4770-9854-bf7da76bbd3d tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:51.814884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2ba6c735-d321-4770-9854-bf7da76bbd3d tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1319 microversion: 2.1 time: 0.168849 Sep 03 01:38:51.815142 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 464/898] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:51 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:52.322226 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=18 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:52.327120 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-91f58d7a-75ba-451c-a42a-6a6cf7ff68c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:52.328031 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-91f58d7a-75ba-451c-a42a-6a6cf7ff68c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:52.336120 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-91f58d7a-75ba-451c-a42a-6a6cf7ff68c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:52.336916 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-91f58d7a-75ba-451c-a42a-6a6cf7ff68c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:52.337538 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-91f58d7a-75ba-451c-a42a-6a6cf7ff68c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:52.344770 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-91f58d7a-75ba-451c-a42a-6a6cf7ff68c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:52.344770 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-91f58d7a-75ba-451c-a42a-6a6cf7ff68c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:52.344770 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-91f58d7a-75ba-451c-a42a-6a6cf7ff68c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:52.380998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=100 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:52.550903 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b0720bca-e429-4223-93e5-fea5bb51cd09 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:52.554562 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b0720bca-e429-4223-93e5-fea5bb51cd09 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:52.575598 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-91f58d7a-75ba-451c-a42a-6a6cf7ff68c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:52.576740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b0720bca-e429-4223-93e5-fea5bb51cd09 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:52.584887 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b0720bca-e429-4223-93e5-fea5bb51cd09 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:52.586944 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b0720bca-e429-4223-93e5-fea5bb51cd09 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:52.590051 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b0720bca-e429-4223-93e5-fea5bb51cd09 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:52.591158 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-91f58d7a-75ba-451c-a42a-6a6cf7ff68c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:52.593106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-91f58d7a-75ba-451c-a42a-6a6cf7ff68c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:52.593718 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b0720bca-e429-4223-93e5-fea5bb51cd09 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:52.593948 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-91f58d7a-75ba-451c-a42a-6a6cf7ff68c7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1407 microversion: 2.20 time: 0.272743 Sep 03 01:38:52.594550 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 435/899] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:52 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:38:52.596644 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b0720bca-e429-4223-93e5-fea5bb51cd09 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:52.838965 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b6fcd5d1-ae79-4861-831f-3d774e11bf62 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:52.839656 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b6fcd5d1-ae79-4861-831f-3d774e11bf62 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:52.846043 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b6fcd5d1-ae79-4861-831f-3d774e11bf62 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:52.846915 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b6fcd5d1-ae79-4861-831f-3d774e11bf62 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:52.847566 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b6fcd5d1-ae79-4861-831f-3d774e11bf62 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:52.848517 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b6fcd5d1-ae79-4861-831f-3d774e11bf62 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:52.849389 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b6fcd5d1-ae79-4861-831f-3d774e11bf62 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:52.850011 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b6fcd5d1-ae79-4861-831f-3d774e11bf62 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:52.882598 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b0720bca-e429-4223-93e5-fea5bb51cd09 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:52.892082 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b0720bca-e429-4223-93e5-fea5bb51cd09 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1361 microversion: 2.1 time: 0.357919 Sep 03 01:38:52.898385 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 465/900] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:52 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1361 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:52.998119 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b6fcd5d1-ae79-4861-831f-3d774e11bf62 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:53.006558 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b6fcd5d1-ae79-4861-831f-3d774e11bf62 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1319 microversion: 2.1 time: 0.171681 Sep 03 01:38:53.007155 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 436/901] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:52 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:53.624431 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e5494e8c-c0d3-4134-a90f-f4f9c47a5c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:53.632650 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e5494e8c-c0d3-4134-a90f-f4f9c47a5c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:53.634613 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5494e8c-c0d3-4134-a90f-f4f9c47a5c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:53.635307 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5494e8c-c0d3-4134-a90f-f4f9c47a5c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:53.635915 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5494e8c-c0d3-4134-a90f-f4f9c47a5c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:53.636861 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5494e8c-c0d3-4134-a90f-f4f9c47a5c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:53.637313 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5494e8c-c0d3-4134-a90f-f4f9c47a5c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:53.637743 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5494e8c-c0d3-4134-a90f-f4f9c47a5c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:53.824192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e5494e8c-c0d3-4134-a90f-f4f9c47a5c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:53.832944 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e5494e8c-c0d3-4134-a90f-f4f9c47a5c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:53.834673 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e5494e8c-c0d3-4134-a90f-f4f9c47a5c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:53.836637 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e5494e8c-c0d3-4134-a90f-f4f9c47a5c7d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1599 microversion: 2.20 time: 0.216385 Sep 03 01:38:53.837282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 466/902] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:38:53 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1599 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:38:53.863288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c4d89f36-1a54-49dc-b5e9-b22cb5b3bebd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:53.863808 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c4d89f36-1a54-49dc-b5e9-b22cb5b3bebd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:53.871212 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c4d89f36-1a54-49dc-b5e9-b22cb5b3bebd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:53.871974 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c4d89f36-1a54-49dc-b5e9-b22cb5b3bebd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:53.872690 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c4d89f36-1a54-49dc-b5e9-b22cb5b3bebd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:53.873616 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c4d89f36-1a54-49dc-b5e9-b22cb5b3bebd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:53.874444 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c4d89f36-1a54-49dc-b5e9-b22cb5b3bebd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:53.875095 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c4d89f36-1a54-49dc-b5e9-b22cb5b3bebd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:53.916394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5fc8d708-920d-4e14-bb55-7092edb2d213 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:53.917392 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5fc8d708-920d-4e14-bb55-7092edb2d213 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:53.924225 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5fc8d708-920d-4e14-bb55-7092edb2d213 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:53.925007 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5fc8d708-920d-4e14-bb55-7092edb2d213 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:53.925805 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5fc8d708-920d-4e14-bb55-7092edb2d213 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:53.927508 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5fc8d708-920d-4e14-bb55-7092edb2d213 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:53.928217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5fc8d708-920d-4e14-bb55-7092edb2d213 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:53.929821 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5fc8d708-920d-4e14-bb55-7092edb2d213 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:54.235518 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5fc8d708-920d-4e14-bb55-7092edb2d213 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:54.245013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5fc8d708-920d-4e14-bb55-7092edb2d213 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1361 microversion: 2.1 time: 0.333670 Sep 03 01:38:54.262700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 467/903] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:53 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1361 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:54.268526 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5941e652-571a-4611-910f-7b01c0417978 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:54.270024 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5941e652-571a-4611-910f-7b01c0417978 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:54.270361 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c4d89f36-1a54-49dc-b5e9-b22cb5b3bebd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.411019 Sep 03 01:38:54.271767 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 437/904] 10.222.0.13 () {60 vars in 1316 bytes} [Sat Sep 3 01:38:53 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/os-interface => generated 284 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:38:54.278836 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5941e652-571a-4611-910f-7b01c0417978 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:54.280036 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5941e652-571a-4611-910f-7b01c0417978 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:54.281157 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5941e652-571a-4611-910f-7b01c0417978 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:54.282080 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5941e652-571a-4611-910f-7b01c0417978 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:54.283302 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5941e652-571a-4611-910f-7b01c0417978 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:54.284060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5941e652-571a-4611-910f-7b01c0417978 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:54.317483 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-c360752a-4317-4329-8748-f3b8af11e29a req-25d52399-808a-4c57-b7ae-882cee548aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b38d9e1-6eef-468f-82e1-a96d8d28214c", "name": "network-vif-plugged", "status": "completed", "tag": "768a2c50-eeb8-48ba-885e-1eab0487f58f"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:54.339469 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-c360752a-4317-4329-8748-f3b8af11e29a req-25d52399-808a-4c57-b7ae-882cee548aa8 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:54.340556 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-c360752a-4317-4329-8748-f3b8af11e29a req-25d52399-808a-4c57-b7ae-882cee548aa8 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:54.341337 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-c360752a-4317-4329-8748-f3b8af11e29a req-25d52399-808a-4c57-b7ae-882cee548aa8 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:54.361566 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-c360752a-4317-4329-8748-f3b8af11e29a req-25d52399-808a-4c57-b7ae-882cee548aa8 service nova] Creating event network-vif-plugged:768a2c50-eeb8-48ba-885e-1eab0487f58f for instance 6b38d9e1-6eef-468f-82e1-a96d8d28214c on hv-cinder-83800 Sep 03 01:38:54.370314 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-c360752a-4317-4329-8748-f3b8af11e29a req-25d52399-808a-4c57-b7ae-882cee548aa8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056365 Sep 03 01:38:54.371949 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 438/905] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:38:54.535657 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5941e652-571a-4611-910f-7b01c0417978 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:54.563254 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5941e652-571a-4611-910f-7b01c0417978 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1319 microversion: 2.1 time: 0.298902 Sep 03 01:38:54.585678 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 468/906] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:54 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:54.756171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-41437e62-03ae-45da-aaaa-79fd6d7c878d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:54.756764 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-41437e62-03ae-45da-aaaa-79fd6d7c878d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:54.768603 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-41437e62-03ae-45da-aaaa-79fd6d7c878d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:54.772593 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-41437e62-03ae-45da-aaaa-79fd6d7c878d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:54.774070 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-41437e62-03ae-45da-aaaa-79fd6d7c878d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:54.775319 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-41437e62-03ae-45da-aaaa-79fd6d7c878d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:54.776126 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-41437e62-03ae-45da-aaaa-79fd6d7c878d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:54.777822 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-41437e62-03ae-45da-aaaa-79fd6d7c878d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:54.829097 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-41437e62-03ae-45da-aaaa-79fd6d7c878d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/ips" status: 200 len: 150 microversion: 2.1 time: 0.180242 Sep 03 01:38:54.830508 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 439/907] 10.222.0.13 () {58 vars in 1248 bytes} [Sat Sep 3 01:38:54 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/ips => generated 150 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:55.278547 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9a598db8-41e3-4798-8c9f-6147e0242903 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:55.283868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9a598db8-41e3-4798-8c9f-6147e0242903 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:55.284548 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:55.289737 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a598db8-41e3-4798-8c9f-6147e0242903 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:55.290449 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a598db8-41e3-4798-8c9f-6147e0242903 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:55.291128 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a598db8-41e3-4798-8c9f-6147e0242903 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:55.292114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a598db8-41e3-4798-8c9f-6147e0242903 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:55.293552 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a598db8-41e3-4798-8c9f-6147e0242903 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:55.294161 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9a598db8-41e3-4798-8c9f-6147e0242903 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:55.368704 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=8 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:38:55.481291 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9a598db8-41e3-4798-8c9f-6147e0242903 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:55.489203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9a598db8-41e3-4798-8c9f-6147e0242903 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1361 microversion: 2.1 time: 0.222559 Sep 03 01:38:55.490394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 469/908] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:55 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1361 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:55.592978 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-64ff9325-cb57-4e2f-ac40-d7052a792230 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:55.593603 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-64ff9325-cb57-4e2f-ac40-d7052a792230 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:55.601599 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-64ff9325-cb57-4e2f-ac40-d7052a792230 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:55.602331 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-64ff9325-cb57-4e2f-ac40-d7052a792230 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:55.603155 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-64ff9325-cb57-4e2f-ac40-d7052a792230 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:55.604051 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-64ff9325-cb57-4e2f-ac40-d7052a792230 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:55.604504 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-64ff9325-cb57-4e2f-ac40-d7052a792230 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:55.605112 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-64ff9325-cb57-4e2f-ac40-d7052a792230 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:55.859148 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-64ff9325-cb57-4e2f-ac40-d7052a792230 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:55.867926 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-213a414a-5b1a-4df5-a26b-b161014d284a req-8c5773e5-506e-4f4f-b37b-43f60b870cae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e156f97d-5465-4597-a836-c70692edfd41", "tag": "b4585caf-c260-4618-ba71-326b4c35ffdf"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:55.869358 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-64ff9325-cb57-4e2f-ac40-d7052a792230 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1319 microversion: 2.1 time: 0.280084 Sep 03 01:38:55.870139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 440/909] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:55 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:55.880855 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-213a414a-5b1a-4df5-a26b-b161014d284a req-8c5773e5-506e-4f4f-b37b-43f60b870cae service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:55.881715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-213a414a-5b1a-4df5-a26b-b161014d284a req-8c5773e5-506e-4f4f-b37b-43f60b870cae service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:55.882326 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-213a414a-5b1a-4df5-a26b-b161014d284a req-8c5773e5-506e-4f4f-b37b-43f60b870cae service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:55.894862 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-213a414a-5b1a-4df5-a26b-b161014d284a req-8c5773e5-506e-4f4f-b37b-43f60b870cae service nova] Creating event network-changed:b4585caf-c260-4618-ba71-326b4c35ffdf for instance e156f97d-5465-4597-a836-c70692edfd41 on hv-cinder-83800 Sep 03 01:38:55.900108 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-213a414a-5b1a-4df5-a26b-b161014d284a req-8c5773e5-506e-4f4f-b37b-43f60b870cae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036664 Sep 03 01:38:55.900702 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 470/910] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:38:56.491343 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-56b038ac-be28-4a53-95bf-35e2604caaff req-200c2242-7d1f-4bea-ba12-0f663e7f36a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6", "name": "network-vif-plugged", "status": "completed", "tag": "032bf397-9317-48c8-8b99-bddb13c489ed"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:56.501506 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-56b038ac-be28-4a53-95bf-35e2604caaff req-200c2242-7d1f-4bea-ba12-0f663e7f36a2 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:56.501970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-56b038ac-be28-4a53-95bf-35e2604caaff req-200c2242-7d1f-4bea-ba12-0f663e7f36a2 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:56.502652 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-56b038ac-be28-4a53-95bf-35e2604caaff req-200c2242-7d1f-4bea-ba12-0f663e7f36a2 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:56.512449 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-4483882b-c3dc-4cce-9c96-98d2662f02ce tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:56.513233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-4483882b-c3dc-4cce-9c96-98d2662f02ce tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:56.519005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-56b038ac-be28-4a53-95bf-35e2604caaff req-200c2242-7d1f-4bea-ba12-0f663e7f36a2 service nova] Creating event network-vif-plugged:032bf397-9317-48c8-8b99-bddb13c489ed for instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 on hv-cinder-83800 Sep 03 01:38:56.526835 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-56b038ac-be28-4a53-95bf-35e2604caaff req-200c2242-7d1f-4bea-ba12-0f663e7f36a2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049364 Sep 03 01:38:56.527561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 441/911] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:56.530262 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4483882b-c3dc-4cce-9c96-98d2662f02ce tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:56.530817 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4483882b-c3dc-4cce-9c96-98d2662f02ce tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:56.531256 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4483882b-c3dc-4cce-9c96-98d2662f02ce tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:56.532010 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4483882b-c3dc-4cce-9c96-98d2662f02ce tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:56.532466 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4483882b-c3dc-4cce-9c96-98d2662f02ce tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:56.532890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-4483882b-c3dc-4cce-9c96-98d2662f02ce tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:56.747269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ea5815da-bacc-4ce4-ac61-14f3c2d219e9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2724c76-57b8-4c32-8d69-bed119aff153"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:56.751448 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ea5815da-bacc-4ce4-ac61-14f3c2d219e9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:56.762687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ea5815da-bacc-4ce4-ac61-14f3c2d219e9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:56.763515 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ea5815da-bacc-4ce4-ac61-14f3c2d219e9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:56.764266 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ea5815da-bacc-4ce4-ac61-14f3c2d219e9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:56.765524 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ea5815da-bacc-4ce4-ac61-14f3c2d219e9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:56.766740 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ea5815da-bacc-4ce4-ac61-14f3c2d219e9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:56.767366 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ea5815da-bacc-4ce4-ac61-14f3c2d219e9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:56.792039 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-4483882b-c3dc-4cce-9c96-98d2662f02ce tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:56.796787 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-4483882b-c3dc-4cce-9c96-98d2662f02ce tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1361 microversion: 2.1 time: 0.288899 Sep 03 01:38:56.801346 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 471/912] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:56 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:56.899448 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-60858e38-d464-4fc8-bf0e-cf06bfa4f584 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:56.900078 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-60858e38-d464-4fc8-bf0e-cf06bfa4f584 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:56.916490 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-60858e38-d464-4fc8-bf0e-cf06bfa4f584 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:56.916990 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-60858e38-d464-4fc8-bf0e-cf06bfa4f584 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:56.920413 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-60858e38-d464-4fc8-bf0e-cf06bfa4f584 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:56.922822 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-60858e38-d464-4fc8-bf0e-cf06bfa4f584 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:56.924693 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-60858e38-d464-4fc8-bf0e-cf06bfa4f584 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:56.925344 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-60858e38-d464-4fc8-bf0e-cf06bfa4f584 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:57.177231 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-60858e38-d464-4fc8-bf0e-cf06bfa4f584 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:57.188007 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-60858e38-d464-4fc8-bf0e-cf06bfa4f584 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1508 microversion: 2.1 time: 0.298799 Sep 03 01:38:57.188610 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 472/913] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:56 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1508 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:38:57.204620 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a615cb6c-1d7f-45ed-ba1f-7738ff86c248 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1898220344"}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:57.208388 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a615cb6c-1d7f-45ed-ba1f-7738ff86c248 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:57.215179 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a615cb6c-1d7f-45ed-ba1f-7738ff86c248 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:57.215739 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a615cb6c-1d7f-45ed-ba1f-7738ff86c248 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:57.216365 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a615cb6c-1d7f-45ed-ba1f-7738ff86c248 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:57.217272 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a615cb6c-1d7f-45ed-ba1f-7738ff86c248 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:57.217782 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a615cb6c-1d7f-45ed-ba1f-7738ff86c248 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:57.218319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a615cb6c-1d7f-45ed-ba1f-7738ff86c248 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:57.370981 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.network.security_group_api [None req-a615cb6c-1d7f-45ed-ba1f-7738ff86c248 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Removing security group 44914223-3606-4f07-acb6-c511676b38c1 from port f1b93106-790d-4f9d-9fae-cd59eef8bc20 Sep 03 01:38:57.655759 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ea5815da-bacc-4ce4-ac61-14f3c2d219e9 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "POST /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.912888 Sep 03 01:38:57.656839 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 442/914] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:38:56 2022] POST /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments => generated 194 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:38:57.672574 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-03791f2f-460d-42ca-8687-df16aa70e81c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a7702fb-6f3c-44ef-9fac-8486fe21d9e6", "device": "/dev/sdb"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:57.678245 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-03791f2f-460d-42ca-8687-df16aa70e81c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:57.686686 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-03791f2f-460d-42ca-8687-df16aa70e81c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:57.687122 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-03791f2f-460d-42ca-8687-df16aa70e81c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:57.687654 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-03791f2f-460d-42ca-8687-df16aa70e81c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:57.688510 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-03791f2f-460d-42ca-8687-df16aa70e81c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:57.689204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-03791f2f-460d-42ca-8687-df16aa70e81c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:57.689739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-03791f2f-460d-42ca-8687-df16aa70e81c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:57.782258 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a615cb6c-1d7f-45ed-ba1f-7738ff86c248 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "POST /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/action" status: 202 len: 0 microversion: 2.1 time: 0.591892 Sep 03 01:38:57.783358 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 473/915] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:38:57 2022] POST /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:38:57.797319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-186bbaa5-5a55-425e-a63d-8eb133a937fc req-2bfd8ca7-d2ce-4f18-a328-63ba120e5e2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5df2d41-c884-4178-9a70-150c16cf1c5f", "tag": "f1b93106-790d-4f9d-9fae-cd59eef8bc20"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:57.824666 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-186bbaa5-5a55-425e-a63d-8eb133a937fc req-2bfd8ca7-d2ce-4f18-a328-63ba120e5e2b service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:57.825484 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-186bbaa5-5a55-425e-a63d-8eb133a937fc req-2bfd8ca7-d2ce-4f18-a328-63ba120e5e2b service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:57.826099 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-186bbaa5-5a55-425e-a63d-8eb133a937fc req-2bfd8ca7-d2ce-4f18-a328-63ba120e5e2b service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:57.851431 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-186bbaa5-5a55-425e-a63d-8eb133a937fc req-2bfd8ca7-d2ce-4f18-a328-63ba120e5e2b service nova] Creating event network-changed:f1b93106-790d-4f9d-9fae-cd59eef8bc20 for instance e5df2d41-c884-4178-9a70-150c16cf1c5f on hv-cinder-83800 Sep 03 01:38:57.860174 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-186bbaa5-5a55-425e-a63d-8eb133a937fc req-2bfd8ca7-d2ce-4f18-a328-63ba120e5e2b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065305 Sep 03 01:38:57.861382 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 474/916] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:57.870229 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c1892747-f62b-44e2-a6ac-70546b16d9c8 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:57.875292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c1892747-f62b-44e2-a6ac-70546b16d9c8 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:57.880895 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c1892747-f62b-44e2-a6ac-70546b16d9c8 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:57.881453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c1892747-f62b-44e2-a6ac-70546b16d9c8 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:57.881940 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c1892747-f62b-44e2-a6ac-70546b16d9c8 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:57.883272 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c1892747-f62b-44e2-a6ac-70546b16d9c8 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:57.883972 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c1892747-f62b-44e2-a6ac-70546b16d9c8 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:57.884412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c1892747-f62b-44e2-a6ac-70546b16d9c8 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:58.110254 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c1892747-f62b-44e2-a6ac-70546b16d9c8 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:58.119250 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c1892747-f62b-44e2-a6ac-70546b16d9c8 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1361 microversion: 2.1 time: 0.255401 Sep 03 01:38:58.119763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 475/917] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:57 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1361 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:58.946155 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-03791f2f-460d-42ca-8687-df16aa70e81c tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "POST /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.287136 Sep 03 01:38:58.946964 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 443/918] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:38:57 2022] POST /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c/os-volume_attachments => generated 194 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:59.142628 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0362c1c9-d044-4c65-865b-cbc91b5e1538 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:59.143341 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0362c1c9-d044-4c65-865b-cbc91b5e1538 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:59.157697 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0362c1c9-d044-4c65-865b-cbc91b5e1538 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:59.158565 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0362c1c9-d044-4c65-865b-cbc91b5e1538 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:59.159067 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0362c1c9-d044-4c65-865b-cbc91b5e1538 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:59.159846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0362c1c9-d044-4c65-865b-cbc91b5e1538 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:59.160349 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0362c1c9-d044-4c65-865b-cbc91b5e1538 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:59.160894 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0362c1c9-d044-4c65-865b-cbc91b5e1538 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:59.391023 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0362c1c9-d044-4c65-865b-cbc91b5e1538 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:38:59.407540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8d6329b7-7a24-4a27-bdd0-1733be7ac52c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:59.408490 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8d6329b7-7a24-4a27-bdd0-1733be7ac52c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:59.414746 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0362c1c9-d044-4c65-865b-cbc91b5e1538 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1361 microversion: 2.1 time: 0.275970 Sep 03 01:38:59.415367 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 476/919] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:38:59 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1361 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:38:59.421730 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8d6329b7-7a24-4a27-bdd0-1733be7ac52c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:59.422225 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8d6329b7-7a24-4a27-bdd0-1733be7ac52c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:59.422769 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-0927d007-736d-4f5b-abe0-3fa8e4fa420f req-f7fc68f0-bf16-481a-a3b9-9d9ba3cb4061 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5df2d41-c884-4178-9a70-150c16cf1c5f", "tag": "f1b93106-790d-4f9d-9fae-cd59eef8bc20"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:38:59.423215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8d6329b7-7a24-4a27-bdd0-1733be7ac52c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:59.423922 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8d6329b7-7a24-4a27-bdd0-1733be7ac52c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:59.424380 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8d6329b7-7a24-4a27-bdd0-1733be7ac52c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:59.424852 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8d6329b7-7a24-4a27-bdd0-1733be7ac52c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:59.434963 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-0927d007-736d-4f5b-abe0-3fa8e4fa420f req-f7fc68f0-bf16-481a-a3b9-9d9ba3cb4061 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:59.435493 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-0927d007-736d-4f5b-abe0-3fa8e4fa420f req-f7fc68f0-bf16-481a-a3b9-9d9ba3cb4061 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:59.435922 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-0927d007-736d-4f5b-abe0-3fa8e4fa420f req-f7fc68f0-bf16-481a-a3b9-9d9ba3cb4061 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:59.451562 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-0927d007-736d-4f5b-abe0-3fa8e4fa420f req-f7fc68f0-bf16-481a-a3b9-9d9ba3cb4061 service nova] Creating event network-changed:f1b93106-790d-4f9d-9fae-cd59eef8bc20 for instance e5df2d41-c884-4178-9a70-150c16cf1c5f on hv-cinder-83800 Sep 03 01:38:59.457528 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-0927d007-736d-4f5b-abe0-3fa8e4fa420f req-f7fc68f0-bf16-481a-a3b9-9d9ba3cb4061 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039112 Sep 03 01:38:59.461105 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 477/920] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:38:59.523211 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-8d6329b7-7a24-4a27-bdd0-1733be7ac52c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lazy-loading 'services' on Instance uuid e5df2d41-c884-4178-9a70-150c16cf1c5f {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:38:59.842869 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8d6329b7-7a24-4a27-bdd0-1733be7ac52c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments/15040863-78fc-4b55-99f3-a542d3944e12" status: 202 len: 0 microversion: 2.1 time: 0.440146 Sep 03 01:38:59.857213 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-95701c70-dc16-43c4-a7df-388a6775a56c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:38:59.859684 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-95701c70-dc16-43c4-a7df-388a6775a56c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:38:59.860120 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 444/921] 10.222.0.13 () {58 vars in 1416 bytes} [Sat Sep 3 01:38:59 2022] DELETE /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments/15040863-78fc-4b55-99f3-a542d3944e12 => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:38:59.876896 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95701c70-dc16-43c4-a7df-388a6775a56c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:59.877402 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95701c70-dc16-43c4-a7df-388a6775a56c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:59.877841 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95701c70-dc16-43c4-a7df-388a6775a56c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:59.878614 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95701c70-dc16-43c4-a7df-388a6775a56c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:38:59.879244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95701c70-dc16-43c4-a7df-388a6775a56c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:38:59.880491 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95701c70-dc16-43c4-a7df-388a6775a56c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:38:59.940759 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-95701c70-dc16-43c4-a7df-388a6775a56c tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088766 Sep 03 01:38:59.942942 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 478/922] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:38:59 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:00.440878 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-57dd164c-836c-406a-8141-fe3e2b0257aa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:00.440878 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-57dd164c-836c-406a-8141-fe3e2b0257aa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:00.448052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57dd164c-836c-406a-8141-fe3e2b0257aa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:00.448829 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57dd164c-836c-406a-8141-fe3e2b0257aa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:00.449304 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57dd164c-836c-406a-8141-fe3e2b0257aa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:00.450226 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57dd164c-836c-406a-8141-fe3e2b0257aa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:00.450785 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57dd164c-836c-406a-8141-fe3e2b0257aa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:00.451407 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-57dd164c-836c-406a-8141-fe3e2b0257aa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:00.599138 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-57dd164c-836c-406a-8141-fe3e2b0257aa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:00.606781 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-57dd164c-836c-406a-8141-fe3e2b0257aa tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1547 microversion: 2.1 time: 0.171969 Sep 03 01:39:00.607344 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 445/923] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:00 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1547 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:00.628796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7fb110d8-01d8-4ed7-981b-4d03053903e3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:00.630249 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7fb110d8-01d8-4ed7-981b-4d03053903e3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:00.636621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7fb110d8-01d8-4ed7-981b-4d03053903e3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:00.637101 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7fb110d8-01d8-4ed7-981b-4d03053903e3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:00.637542 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7fb110d8-01d8-4ed7-981b-4d03053903e3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:00.638230 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7fb110d8-01d8-4ed7-981b-4d03053903e3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:00.638712 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7fb110d8-01d8-4ed7-981b-4d03053903e3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:00.639136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7fb110d8-01d8-4ed7-981b-4d03053903e3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:00.717536 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7fb110d8-01d8-4ed7-981b-4d03053903e3 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092682 Sep 03 01:39:00.718141 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 479/924] 10.222.0.13 () {58 vars in 1275 bytes} [Sat Sep 3 01:39:00 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:00.960672 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-00fdc054-dfb5-48bb-9196-c794615a71fb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:00.963255 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-00fdc054-dfb5-48bb-9196-c794615a71fb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:00.969525 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-00fdc054-dfb5-48bb-9196-c794615a71fb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:00.970107 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-00fdc054-dfb5-48bb-9196-c794615a71fb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:00.970645 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-00fdc054-dfb5-48bb-9196-c794615a71fb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:00.971414 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-00fdc054-dfb5-48bb-9196-c794615a71fb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:00.971944 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-00fdc054-dfb5-48bb-9196-c794615a71fb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:00.972441 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-00fdc054-dfb5-48bb-9196-c794615a71fb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:01.003381 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-00fdc054-dfb5-48bb-9196-c794615a71fb tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046856 Sep 03 01:39:01.004006 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 446/925] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:00 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:01.789556 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-c29e3dfe-43ff-445b-bdba-77c2277a82ee req-79bac1fe-c0d9-49ea-bed5-c95f5663a31c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6", "tag": "032bf397-9317-48c8-8b99-bddb13c489ed"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:39:01.813435 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-c29e3dfe-43ff-445b-bdba-77c2277a82ee req-79bac1fe-c0d9-49ea-bed5-c95f5663a31c service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:01.814331 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-c29e3dfe-43ff-445b-bdba-77c2277a82ee req-79bac1fe-c0d9-49ea-bed5-c95f5663a31c service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:01.814852 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-c29e3dfe-43ff-445b-bdba-77c2277a82ee req-79bac1fe-c0d9-49ea-bed5-c95f5663a31c service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:01.837453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-c29e3dfe-43ff-445b-bdba-77c2277a82ee req-79bac1fe-c0d9-49ea-bed5-c95f5663a31c service nova] Creating event network-changed:032bf397-9317-48c8-8b99-bddb13c489ed for instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 on hv-cinder-83800 Sep 03 01:39:01.842820 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-c29e3dfe-43ff-445b-bdba-77c2277a82ee req-79bac1fe-c0d9-49ea-bed5-c95f5663a31c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059474 Sep 03 01:39:01.843582 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 480/926] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:02.015958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f85d14ff-e9bf-40f5-ba76-b200c167c890 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:02.018178 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f85d14ff-e9bf-40f5-ba76-b200c167c890 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:02.027139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f85d14ff-e9bf-40f5-ba76-b200c167c890 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:02.027898 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f85d14ff-e9bf-40f5-ba76-b200c167c890 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:02.029020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f85d14ff-e9bf-40f5-ba76-b200c167c890 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:02.030008 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f85d14ff-e9bf-40f5-ba76-b200c167c890 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:02.030667 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f85d14ff-e9bf-40f5-ba76-b200c167c890 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:02.031262 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f85d14ff-e9bf-40f5-ba76-b200c167c890 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:02.100566 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f85d14ff-e9bf-40f5-ba76-b200c167c890 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088108 Sep 03 01:39:02.101883 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 447/927] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:02 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:03.115985 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5de72d50-f062-4057-8229-d0feeff863d1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:03.118454 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5de72d50-f062-4057-8229-d0feeff863d1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:03.124908 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5de72d50-f062-4057-8229-d0feeff863d1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:03.125358 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5de72d50-f062-4057-8229-d0feeff863d1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:03.125789 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5de72d50-f062-4057-8229-d0feeff863d1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:03.126506 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5de72d50-f062-4057-8229-d0feeff863d1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:03.126961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5de72d50-f062-4057-8229-d0feeff863d1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:03.127377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5de72d50-f062-4057-8229-d0feeff863d1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:03.157346 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5de72d50-f062-4057-8229-d0feeff863d1 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047633 Sep 03 01:39:03.158984 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 481/928] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:03 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:04.170522 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-576d9073-9a47-437a-8575-31d6fe27dedf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:04.172747 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-576d9073-9a47-437a-8575-31d6fe27dedf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:04.180207 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-576d9073-9a47-437a-8575-31d6fe27dedf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:04.180709 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-576d9073-9a47-437a-8575-31d6fe27dedf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:04.181155 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-576d9073-9a47-437a-8575-31d6fe27dedf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:04.181853 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-576d9073-9a47-437a-8575-31d6fe27dedf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:04.182313 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-576d9073-9a47-437a-8575-31d6fe27dedf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:04.182779 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-576d9073-9a47-437a-8575-31d6fe27dedf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:04.220315 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-576d9073-9a47-437a-8575-31d6fe27dedf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053711 Sep 03 01:39:04.220860 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 448/929] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:04 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:05.233051 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b6affb46-cdeb-4dbd-944b-be44497f6346 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:05.235194 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b6affb46-cdeb-4dbd-944b-be44497f6346 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:05.243247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6affb46-cdeb-4dbd-944b-be44497f6346 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:05.243444 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6affb46-cdeb-4dbd-944b-be44497f6346 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:05.243838 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6affb46-cdeb-4dbd-944b-be44497f6346 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:05.244529 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6affb46-cdeb-4dbd-944b-be44497f6346 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:05.244970 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6affb46-cdeb-4dbd-944b-be44497f6346 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:05.245615 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6affb46-cdeb-4dbd-944b-be44497f6346 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:05.251295 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:05.277535 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b6affb46-cdeb-4dbd-944b-be44497f6346 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049073 Sep 03 01:39:05.278050 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 482/930] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:05 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:06.290384 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1a3e60c8-8dcd-47f5-a524-67f19dc1c797 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:06.292507 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1a3e60c8-8dcd-47f5-a524-67f19dc1c797 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:06.298989 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1a3e60c8-8dcd-47f5-a524-67f19dc1c797 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:06.299475 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1a3e60c8-8dcd-47f5-a524-67f19dc1c797 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:06.299909 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1a3e60c8-8dcd-47f5-a524-67f19dc1c797 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:06.300597 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1a3e60c8-8dcd-47f5-a524-67f19dc1c797 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:06.301047 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1a3e60c8-8dcd-47f5-a524-67f19dc1c797 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:06.301477 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1a3e60c8-8dcd-47f5-a524-67f19dc1c797 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:06.329890 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1a3e60c8-8dcd-47f5-a524-67f19dc1c797 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044453 Sep 03 01:39:06.330489 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 449/931] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:06 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:06.479812 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f8a68638-6122-4cfa-bf60-3c2f7c6ac87e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2724c76-57b8-4c32-8d69-bed119aff153"}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:39:06.482591 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f8a68638-6122-4cfa-bf60-3c2f7c6ac87e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:06.489405 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f8a68638-6122-4cfa-bf60-3c2f7c6ac87e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:06.489896 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f8a68638-6122-4cfa-bf60-3c2f7c6ac87e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:06.490331 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f8a68638-6122-4cfa-bf60-3c2f7c6ac87e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:06.491330 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f8a68638-6122-4cfa-bf60-3c2f7c6ac87e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:06.491789 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f8a68638-6122-4cfa-bf60-3c2f7c6ac87e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:06.492214 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f8a68638-6122-4cfa-bf60-3c2f7c6ac87e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:06.581842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-f8a68638-6122-4cfa-bf60-3c2f7c6ac87e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Invalid volume: volume f2724c76-57b8-4c32-8d69-bed119aff153 is already attached to instances: 3fb78ff3-5840-45d5-8185-450243588142 Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f8a68638-6122-4cfa-bf60-3c2f7c6ac87e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: POST /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments HTTP/1.1 Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 74 Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:39:06.584453 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:39:06.586109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:39:06.586109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:39:06.586109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:39:06.586109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:39:06.586109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:39:06.586109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:39:06.586109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:39:06.586109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:39:06.586109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:39:06.586109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Sep 03 01:39:06.586109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {"volumeAttachment": {"volumeId": "f2724c76-57b8-4c32-8d69-bed119aff153"}} Sep 03 01:39:06.586109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Invalid volume: volume f2724c76-57b8-4c32-8d69-bed119aff153 is already attached to instances: 3fb78ff3-5840-45d5-8185-450243588142 Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'server_id': '3fb78ff3-5840-45d5-8185-450243588142', 'body': {'volumeAttachment': {'volumeId': 'f2724c76-57b8-4c32-8d69-bed119aff153'}}} Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f2724c76-57b8-4c32-8d69-bed119aff153 is already attached to instances: 3fb78ff3-5840-45d5-8185-450243588142 Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:39:06.587088 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f2724c76-57b8-4c32-8d69-bed119aff153 is already attached to instances: 3fb78ff3-5840-45d5-8185-450243588142 Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:06.588403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:39:06.589668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:39:06.589668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:39:06.589668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:39:06.589668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f2724c76-57b8-4c32-8d69-bed119aff153 is already attached to instances: 3fb78ff3-5840-45d5-8185-450243588142 Sep 03 01:39:06.589668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:39:06.589668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f8a68638-6122-4cfa-bf60-3c2f7c6ac87e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 400 to user: Invalid volume: volume f2724c76-57b8-4c32-8d69-bed119aff153 is already attached to instances: 3fb78ff3-5840-45d5-8185-450243588142 {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:39:06.589668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f8a68638-6122-4cfa-bf60-3c2f7c6ac87e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "POST /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110144 Sep 03 01:39:06.589668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 483/932] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:39:06 2022] POST /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments => generated 174 bytes in 111 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 01:39:06.652472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8ef355cd-bebd-4521-b78c-91001a467863 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:06.652918 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8ef355cd-bebd-4521-b78c-91001a467863 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:06.659134 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8ef355cd-bebd-4521-b78c-91001a467863 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:06.659619 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8ef355cd-bebd-4521-b78c-91001a467863 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:06.660060 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8ef355cd-bebd-4521-b78c-91001a467863 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:06.660898 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8ef355cd-bebd-4521-b78c-91001a467863 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:06.661691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8ef355cd-bebd-4521-b78c-91001a467863 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:06.662129 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8ef355cd-bebd-4521-b78c-91001a467863 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:06.679790 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:06.752767 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-8ef355cd-bebd-4521-b78c-91001a467863 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lazy-loading 'services' on Instance uuid 3fb78ff3-5840-45d5-8185-450243588142 {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:39:07.013525 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8ef355cd-bebd-4521-b78c-91001a467863 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments/f2724c76-57b8-4c32-8d69-bed119aff153" status: 202 len: 0 microversion: 2.1 time: 0.364801 Sep 03 01:39:07.014154 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 450/933] 10.222.0.13 () {58 vars in 1416 bytes} [Sat Sep 3 01:39:06 2022] DELETE /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments/f2724c76-57b8-4c32-8d69-bed119aff153 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:39:07.023960 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-10b37d4e-f6f9-4d54-bfbc-7d60a206e16e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:07.026190 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-10b37d4e-f6f9-4d54-bfbc-7d60a206e16e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:07.033390 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-10b37d4e-f6f9-4d54-bfbc-7d60a206e16e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:07.033873 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-10b37d4e-f6f9-4d54-bfbc-7d60a206e16e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:07.034322 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-10b37d4e-f6f9-4d54-bfbc-7d60a206e16e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:07.035045 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-10b37d4e-f6f9-4d54-bfbc-7d60a206e16e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:07.035496 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-10b37d4e-f6f9-4d54-bfbc-7d60a206e16e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:07.036003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-10b37d4e-f6f9-4d54-bfbc-7d60a206e16e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:07.065416 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-10b37d4e-f6f9-4d54-bfbc-7d60a206e16e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046525 Sep 03 01:39:07.065967 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 484/934] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:07 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:39:07.343939 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8b0426d6-c1f9-4742-b45e-6d24ee31ba17 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:07.346244 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8b0426d6-c1f9-4742-b45e-6d24ee31ba17 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:07.353543 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8b0426d6-c1f9-4742-b45e-6d24ee31ba17 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:07.354020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8b0426d6-c1f9-4742-b45e-6d24ee31ba17 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:07.354478 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8b0426d6-c1f9-4742-b45e-6d24ee31ba17 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:07.355158 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8b0426d6-c1f9-4742-b45e-6d24ee31ba17 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:07.355610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8b0426d6-c1f9-4742-b45e-6d24ee31ba17 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:07.356026 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8b0426d6-c1f9-4742-b45e-6d24ee31ba17 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:07.385639 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8b0426d6-c1f9-4742-b45e-6d24ee31ba17 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046260 Sep 03 01:39:07.386236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 451/935] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:07 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:08.079069 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c8548f1f-493c-418f-ae16-c050befdfbba tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:08.081114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c8548f1f-493c-418f-ae16-c050befdfbba tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:08.087511 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8548f1f-493c-418f-ae16-c050befdfbba tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:08.087997 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8548f1f-493c-418f-ae16-c050befdfbba tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:08.089834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8548f1f-493c-418f-ae16-c050befdfbba tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:08.089834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8548f1f-493c-418f-ae16-c050befdfbba tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:08.089834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8548f1f-493c-418f-ae16-c050befdfbba tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:08.090229 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c8548f1f-493c-418f-ae16-c050befdfbba tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:08.119563 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c8548f1f-493c-418f-ae16-c050befdfbba tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044596 Sep 03 01:39:08.120116 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 485/936] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:08 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:08.399133 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-707aefe0-d111-4684-b62e-bd998d5dca10 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:08.401254 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-707aefe0-d111-4684-b62e-bd998d5dca10 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:08.407700 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-707aefe0-d111-4684-b62e-bd998d5dca10 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:08.408438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-707aefe0-d111-4684-b62e-bd998d5dca10 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:08.408902 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-707aefe0-d111-4684-b62e-bd998d5dca10 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:08.409586 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-707aefe0-d111-4684-b62e-bd998d5dca10 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:08.410034 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-707aefe0-d111-4684-b62e-bd998d5dca10 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:08.410505 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-707aefe0-d111-4684-b62e-bd998d5dca10 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:08.441074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-707aefe0-d111-4684-b62e-bd998d5dca10 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046790 Sep 03 01:39:08.441642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 452/937] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:08 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:09.131446 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d45bba1d-93d2-48a6-a929-1898c88bd8e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:09.133670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d45bba1d-93d2-48a6-a929-1898c88bd8e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:09.140030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d45bba1d-93d2-48a6-a929-1898c88bd8e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:09.142167 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d45bba1d-93d2-48a6-a929-1898c88bd8e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:09.142167 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d45bba1d-93d2-48a6-a929-1898c88bd8e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:09.142167 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d45bba1d-93d2-48a6-a929-1898c88bd8e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:09.142167 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d45bba1d-93d2-48a6-a929-1898c88bd8e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:09.142627 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d45bba1d-93d2-48a6-a929-1898c88bd8e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:09.173412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d45bba1d-93d2-48a6-a929-1898c88bd8e8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045919 Sep 03 01:39:09.176752 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 486/938] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:09 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:09.454203 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4131d66d-6833-4abe-b37f-3476d309f173 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:09.456313 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4131d66d-6833-4abe-b37f-3476d309f173 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:09.463302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4131d66d-6833-4abe-b37f-3476d309f173 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:09.463781 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4131d66d-6833-4abe-b37f-3476d309f173 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:09.464216 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4131d66d-6833-4abe-b37f-3476d309f173 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:09.464899 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4131d66d-6833-4abe-b37f-3476d309f173 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:09.465349 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4131d66d-6833-4abe-b37f-3476d309f173 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:09.465766 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4131d66d-6833-4abe-b37f-3476d309f173 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:09.494734 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4131d66d-6833-4abe-b37f-3476d309f173 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044515 Sep 03 01:39:09.495291 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 453/939] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:09 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:10.185694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-36cbf8cc-d71b-46a5-94e8-edb4f1a3c109 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:10.187859 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-36cbf8cc-d71b-46a5-94e8-edb4f1a3c109 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:10.196714 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-36cbf8cc-d71b-46a5-94e8-edb4f1a3c109 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:10.196714 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-36cbf8cc-d71b-46a5-94e8-edb4f1a3c109 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:10.196982 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-36cbf8cc-d71b-46a5-94e8-edb4f1a3c109 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:10.197635 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-36cbf8cc-d71b-46a5-94e8-edb4f1a3c109 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:10.198085 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-36cbf8cc-d71b-46a5-94e8-edb4f1a3c109 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:10.198595 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-36cbf8cc-d71b-46a5-94e8-edb4f1a3c109 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:10.229106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-36cbf8cc-d71b-46a5-94e8-edb4f1a3c109 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047530 Sep 03 01:39:10.230008 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 487/940] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:10 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:10.506918 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4df45217-36a2-4261-9fed-035ec63cdd05 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:10.509035 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4df45217-36a2-4261-9fed-035ec63cdd05 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:10.515397 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4df45217-36a2-4261-9fed-035ec63cdd05 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:10.515914 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4df45217-36a2-4261-9fed-035ec63cdd05 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:10.516345 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4df45217-36a2-4261-9fed-035ec63cdd05 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:10.517020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4df45217-36a2-4261-9fed-035ec63cdd05 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:10.517552 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4df45217-36a2-4261-9fed-035ec63cdd05 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:10.518007 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4df45217-36a2-4261-9fed-035ec63cdd05 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:10.548608 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4df45217-36a2-4261-9fed-035ec63cdd05 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045676 Sep 03 01:39:10.549164 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 454/941] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:10 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:11.244715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-34141b5a-b98c-4e5c-866e-83dcdb8a5a6f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:11.247062 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-34141b5a-b98c-4e5c-866e-83dcdb8a5a6f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:11.253411 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-34141b5a-b98c-4e5c-866e-83dcdb8a5a6f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:11.253948 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-34141b5a-b98c-4e5c-866e-83dcdb8a5a6f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:11.254299 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-34141b5a-b98c-4e5c-866e-83dcdb8a5a6f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:11.255000 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-34141b5a-b98c-4e5c-866e-83dcdb8a5a6f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:11.255452 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-34141b5a-b98c-4e5c-866e-83dcdb8a5a6f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:11.256386 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-34141b5a-b98c-4e5c-866e-83dcdb8a5a6f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:11.287985 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-34141b5a-b98c-4e5c-866e-83dcdb8a5a6f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046885 Sep 03 01:39:11.288551 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 488/942] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:11 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:11.561686 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-fa37aae5-f7fa-4ad4-b267-5fa08698fe48 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:11.563833 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-fa37aae5-f7fa-4ad4-b267-5fa08698fe48 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:11.571798 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fa37aae5-f7fa-4ad4-b267-5fa08698fe48 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:11.573013 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fa37aae5-f7fa-4ad4-b267-5fa08698fe48 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:11.573013 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fa37aae5-f7fa-4ad4-b267-5fa08698fe48 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:11.575205 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fa37aae5-f7fa-4ad4-b267-5fa08698fe48 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:11.575685 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fa37aae5-f7fa-4ad4-b267-5fa08698fe48 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:11.576381 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fa37aae5-f7fa-4ad4-b267-5fa08698fe48 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:11.606952 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-fa37aae5-f7fa-4ad4-b267-5fa08698fe48 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049112 Sep 03 01:39:11.607700 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 455/943] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:11 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:12.300503 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ee55be44-503d-406c-bb03-55d90c80cd9f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:12.302638 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ee55be44-503d-406c-bb03-55d90c80cd9f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:12.314916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ee55be44-503d-406c-bb03-55d90c80cd9f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:12.314916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ee55be44-503d-406c-bb03-55d90c80cd9f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:12.314916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ee55be44-503d-406c-bb03-55d90c80cd9f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:12.314916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ee55be44-503d-406c-bb03-55d90c80cd9f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:12.315466 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ee55be44-503d-406c-bb03-55d90c80cd9f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:12.315466 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ee55be44-503d-406c-bb03-55d90c80cd9f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:12.343939 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ee55be44-503d-406c-bb03-55d90c80cd9f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047441 Sep 03 01:39:12.348890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 489/944] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:12 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:12.620365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-16877287-7db5-4f02-8362-b88514e2426b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:12.622670 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-16877287-7db5-4f02-8362-b88514e2426b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:12.629198 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-16877287-7db5-4f02-8362-b88514e2426b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:12.629680 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-16877287-7db5-4f02-8362-b88514e2426b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:12.630112 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-16877287-7db5-4f02-8362-b88514e2426b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:12.630840 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-16877287-7db5-4f02-8362-b88514e2426b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:12.631322 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-16877287-7db5-4f02-8362-b88514e2426b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:12.631748 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-16877287-7db5-4f02-8362-b88514e2426b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:12.660643 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-16877287-7db5-4f02-8362-b88514e2426b tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045032 Sep 03 01:39:12.661191 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 456/945] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:12 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:13.356826 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-887fce69-9120-4bca-ab92-035b1ba7c07b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:13.358935 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-887fce69-9120-4bca-ab92-035b1ba7c07b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:13.366023 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-887fce69-9120-4bca-ab92-035b1ba7c07b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:13.366707 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-887fce69-9120-4bca-ab92-035b1ba7c07b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:13.367140 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-887fce69-9120-4bca-ab92-035b1ba7c07b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:13.367833 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-887fce69-9120-4bca-ab92-035b1ba7c07b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:13.368277 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-887fce69-9120-4bca-ab92-035b1ba7c07b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:13.368696 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-887fce69-9120-4bca-ab92-035b1ba7c07b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:13.398167 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-887fce69-9120-4bca-ab92-035b1ba7c07b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045330 Sep 03 01:39:13.398777 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 490/946] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:13 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:13.673375 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0ba3ab35-3e58-48e3-952d-050abbeffced tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:13.675766 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-0ba3ab35-3e58-48e3-952d-050abbeffced tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:13.682302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0ba3ab35-3e58-48e3-952d-050abbeffced tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:13.682839 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0ba3ab35-3e58-48e3-952d-050abbeffced tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:13.683276 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0ba3ab35-3e58-48e3-952d-050abbeffced tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:13.683975 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0ba3ab35-3e58-48e3-952d-050abbeffced tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:13.684427 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0ba3ab35-3e58-48e3-952d-050abbeffced tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:13.684850 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0ba3ab35-3e58-48e3-952d-050abbeffced tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:13.714384 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0ba3ab35-3e58-48e3-952d-050abbeffced tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044951 Sep 03 01:39:13.714946 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 457/947] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:13 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:14.411585 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-06248b4d-61d2-4e08-9f75-3c2a7b95a348 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:14.414376 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-06248b4d-61d2-4e08-9f75-3c2a7b95a348 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:14.420632 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-06248b4d-61d2-4e08-9f75-3c2a7b95a348 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:14.421115 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-06248b4d-61d2-4e08-9f75-3c2a7b95a348 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:14.421553 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-06248b4d-61d2-4e08-9f75-3c2a7b95a348 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:14.422245 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-06248b4d-61d2-4e08-9f75-3c2a7b95a348 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:14.422726 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-06248b4d-61d2-4e08-9f75-3c2a7b95a348 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:14.423203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-06248b4d-61d2-4e08-9f75-3c2a7b95a348 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:14.452420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-06248b4d-61d2-4e08-9f75-3c2a7b95a348 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045170 Sep 03 01:39:14.452977 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 491/948] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:14 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:14.726759 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4fbae260-1f06-4ba6-82b7-b8d621bbda0a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:14.728910 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4fbae260-1f06-4ba6-82b7-b8d621bbda0a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:14.735288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4fbae260-1f06-4ba6-82b7-b8d621bbda0a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:14.735798 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4fbae260-1f06-4ba6-82b7-b8d621bbda0a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:14.736347 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4fbae260-1f06-4ba6-82b7-b8d621bbda0a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:14.737032 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4fbae260-1f06-4ba6-82b7-b8d621bbda0a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:14.737479 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4fbae260-1f06-4ba6-82b7-b8d621bbda0a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:14.737902 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4fbae260-1f06-4ba6-82b7-b8d621bbda0a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:14.766882 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4fbae260-1f06-4ba6-82b7-b8d621bbda0a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044542 Sep 03 01:39:14.767426 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 458/949] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:14 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:15.465768 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-aca95408-30a5-464b-8691-6e987e11d70b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:15.468434 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-aca95408-30a5-464b-8691-6e987e11d70b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:15.476000 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aca95408-30a5-464b-8691-6e987e11d70b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:15.476507 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aca95408-30a5-464b-8691-6e987e11d70b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:15.477148 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aca95408-30a5-464b-8691-6e987e11d70b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:15.477852 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aca95408-30a5-464b-8691-6e987e11d70b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:15.478317 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aca95408-30a5-464b-8691-6e987e11d70b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:15.478774 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aca95408-30a5-464b-8691-6e987e11d70b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:15.508929 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-aca95408-30a5-464b-8691-6e987e11d70b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047912 Sep 03 01:39:15.509508 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 492/950] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:15 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:15.778588 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-291db7ec-e52c-4e06-9cbd-05800fbd7bb5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:15.780707 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-291db7ec-e52c-4e06-9cbd-05800fbd7bb5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:15.787999 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-291db7ec-e52c-4e06-9cbd-05800fbd7bb5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:15.788421 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-291db7ec-e52c-4e06-9cbd-05800fbd7bb5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:15.788856 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-291db7ec-e52c-4e06-9cbd-05800fbd7bb5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:15.789548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-291db7ec-e52c-4e06-9cbd-05800fbd7bb5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:15.789997 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-291db7ec-e52c-4e06-9cbd-05800fbd7bb5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:15.790448 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-291db7ec-e52c-4e06-9cbd-05800fbd7bb5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:15.821781 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-291db7ec-e52c-4e06-9cbd-05800fbd7bb5 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047229 Sep 03 01:39:15.822570 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 459/951] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:15 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:16.530735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ef774d57-a746-4f07-a180-6f18bba7a947 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:16.530735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ef774d57-a746-4f07-a180-6f18bba7a947 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:16.530735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef774d57-a746-4f07-a180-6f18bba7a947 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:16.531549 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef774d57-a746-4f07-a180-6f18bba7a947 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:16.531549 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef774d57-a746-4f07-a180-6f18bba7a947 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:16.531973 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef774d57-a746-4f07-a180-6f18bba7a947 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:16.532429 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef774d57-a746-4f07-a180-6f18bba7a947 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:16.532858 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ef774d57-a746-4f07-a180-6f18bba7a947 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:16.563072 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ef774d57-a746-4f07-a180-6f18bba7a947 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045899 Sep 03 01:39:16.565114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 493/952] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:16 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:16.833923 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-25a2e8fb-1045-4b4e-8a1b-d754993cb2db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:16.836212 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-25a2e8fb-1045-4b4e-8a1b-d754993cb2db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:16.843128 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25a2e8fb-1045-4b4e-8a1b-d754993cb2db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:16.843620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25a2e8fb-1045-4b4e-8a1b-d754993cb2db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:16.844058 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25a2e8fb-1045-4b4e-8a1b-d754993cb2db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:16.844880 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25a2e8fb-1045-4b4e-8a1b-d754993cb2db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:16.845358 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25a2e8fb-1045-4b4e-8a1b-d754993cb2db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:16.845781 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25a2e8fb-1045-4b4e-8a1b-d754993cb2db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:16.875602 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-25a2e8fb-1045-4b4e-8a1b-d754993cb2db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045563 Sep 03 01:39:16.876162 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 460/953] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:16 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 01:39:16.887696 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-12c8dc54-3e86-45bd-978a-857d90806b49 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:16.888184 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-12c8dc54-3e86-45bd-978a-857d90806b49 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:16.894055 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-12c8dc54-3e86-45bd-978a-857d90806b49 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:16.895118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-12c8dc54-3e86-45bd-978a-857d90806b49 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:16.895554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-12c8dc54-3e86-45bd-978a-857d90806b49 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:16.896227 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-12c8dc54-3e86-45bd-978a-857d90806b49 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:16.896676 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-12c8dc54-3e86-45bd-978a-857d90806b49 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:16.897130 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-12c8dc54-3e86-45bd-978a-857d90806b49 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:16.970964 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-12c8dc54-3e86-45bd-978a-857d90806b49 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] HTTP exception thrown: Instance e5df2d41-c884-4178-9a70-150c16cf1c5f is not attached to volume 15040863-78fc-4b55-99f3-a542d3944e12 Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-12c8dc54-3e86-45bd-978a-857d90806b49 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Request method failure captured: Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: DELETE /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments/15040863-78fc-4b55-99f3-a542d3944e12 HTTP/1.1 Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq9lR3_wcVialq5XMuMg7kcvdeQrirJg5m4vGDSIEknDPca7HbNjF6bYyqAl7nDUw1oe0cUnAaAaFjIrwxrUvS6IgZGN_gRcntgVbsSj7E1l3ALhvDFV3cGm-h3TRbttQS8XG2qI9cKj6P0IBsvR0t_LpR0nxbMeEsEXFer1dwAlXjg Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 364812df6abf492698453972e9a1d120 Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-TestMinimumBasicScenario-1297237569 Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:39:16.985544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:39:16.987347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_364812df6abf492698453972e9a1d120"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/364812df6abf492698453972e9a1d120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/364812df6abf492698453972e9a1d120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/364812df6abf492698453972e9a1d120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:39:16.987347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-TestMinimumBasicScenario-1297237569 Sep 03 01:39:16.987347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 364812df6abf492698453972e9a1d120 Sep 03 01:39:16.987347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1297237569 Sep 03 01:39:16.987347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-TestMinimumBasicScenario-1297237569-project Sep 03 01:39:16.987347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:39:16.987347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:39:16.987347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: b8349bd45ad84f14858f73bf42b48380 Sep 03 01:39:16.987347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-TestMinimumBasicScenario-1297237569-project Sep 03 01:39:16.987347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:39:16.987347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance e5df2d41-c884-4178-9a70-150c16cf1c5f is not attached to volume 15040863-78fc-4b55-99f3-a542d3944e12 Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'server_id': 'e5df2d41-c884-4178-9a70-150c16cf1c5f', 'id': '15040863-78fc-4b55-99f3-a542d3944e12'} Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 15040863-78fc-4b55-99f3-a542d3944e12. Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:39:16.988169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5df2d41-c884-4178-9a70-150c16cf1c5f is not attached to volume 15040863-78fc-4b55-99f3-a542d3944e12 Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5df2d41-c884-4178-9a70-150c16cf1c5f is not attached to volume 15040863-78fc-4b55-99f3-a542d3944e12 Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:39:16.989681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-12c8dc54-3e86-45bd-978a-857d90806b49 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Returning 404 to user: Instance e5df2d41-c884-4178-9a70-150c16cf1c5f is not attached to volume 15040863-78fc-4b55-99f3-a542d3944e12 {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:39:16.991404 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-12c8dc54-3e86-45bd-978a-857d90806b49 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments/15040863-78fc-4b55-99f3-a542d3944e12" status: 404 len: 154 microversion: 2.1 time: 0.103537 Sep 03 01:39:16.991404 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 494/954] 10.222.0.13 () {58 vars in 1416 bytes} [Sat Sep 3 01:39:16 2022] DELETE /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f/os-volume_attachments/15040863-78fc-4b55-99f3-a542d3944e12 => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:39:17.575399 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ecc41343-8142-4f41-a523-53242fca6db2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:17.577628 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ecc41343-8142-4f41-a523-53242fca6db2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:17.583686 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecc41343-8142-4f41-a523-53242fca6db2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:17.602033 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecc41343-8142-4f41-a523-53242fca6db2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:17.602033 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecc41343-8142-4f41-a523-53242fca6db2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:17.602033 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecc41343-8142-4f41-a523-53242fca6db2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:17.602033 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecc41343-8142-4f41-a523-53242fca6db2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:17.602643 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecc41343-8142-4f41-a523-53242fca6db2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:17.616449 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ecc41343-8142-4f41-a523-53242fca6db2 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045140 Sep 03 01:39:17.617012 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 461/955] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:17 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 01:39:17.793912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a045ce5f-1a46-4b64-8cde-625a91d5e5ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:17.794526 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a045ce5f-1a46-4b64-8cde-625a91d5e5ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:17.801569 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a045ce5f-1a46-4b64-8cde-625a91d5e5ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:17.802286 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a045ce5f-1a46-4b64-8cde-625a91d5e5ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:17.802951 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a045ce5f-1a46-4b64-8cde-625a91d5e5ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:17.803930 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a045ce5f-1a46-4b64-8cde-625a91d5e5ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:17.804286 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a045ce5f-1a46-4b64-8cde-625a91d5e5ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:17.805678 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a045ce5f-1a46-4b64-8cde-625a91d5e5ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:17.833835 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a045ce5f-1a46-4b64-8cde-625a91d5e5ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Going to try to terminate instance {{(pid=127552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:39:18.151573 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a045ce5f-1a46-4b64-8cde-625a91d5e5ca tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 204 len: 0 microversion: 2.1 time: 0.361711 Sep 03 01:39:18.152158 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 495/956] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:39:17 2022] DELETE /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:39:18.160696 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e8a6b54c-1be8-4bd2-b78a-65a7768bcbd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:18.161338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e8a6b54c-1be8-4bd2-b78a-65a7768bcbd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:18.168599 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e8a6b54c-1be8-4bd2-b78a-65a7768bcbd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:18.169093 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e8a6b54c-1be8-4bd2-b78a-65a7768bcbd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:18.169526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e8a6b54c-1be8-4bd2-b78a-65a7768bcbd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:18.170217 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e8a6b54c-1be8-4bd2-b78a-65a7768bcbd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:18.170704 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e8a6b54c-1be8-4bd2-b78a-65a7768bcbd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:18.171127 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e8a6b54c-1be8-4bd2-b78a-65a7768bcbd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:18.225101 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f36c142f-f59b-4d54-81f9-e2381cd02aaf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:18.226237 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f36c142f-f59b-4d54-81f9-e2381cd02aaf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:18.237504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f36c142f-f59b-4d54-81f9-e2381cd02aaf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:18.240064 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f36c142f-f59b-4d54-81f9-e2381cd02aaf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:18.240064 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f36c142f-f59b-4d54-81f9-e2381cd02aaf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:18.240064 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f36c142f-f59b-4d54-81f9-e2381cd02aaf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:18.240064 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f36c142f-f59b-4d54-81f9-e2381cd02aaf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:18.240655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f36c142f-f59b-4d54-81f9-e2381cd02aaf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:18.265223 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f36c142f-f59b-4d54-81f9-e2381cd02aaf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Going to try to terminate instance {{(pid=127552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:39:18.280054 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:18.327300 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e8a6b54c-1be8-4bd2-b78a-65a7768bcbd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:18.335572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e8a6b54c-1be8-4bd2-b78a-65a7768bcbd7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1680 microversion: 2.1 time: 0.179106 Sep 03 01:39:18.336140 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 462/957] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:18 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1680 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:39:18.465345 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f36c142f-f59b-4d54-81f9-e2381cd02aaf tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 204 len: 0 microversion: 2.1 time: 0.245369 Sep 03 01:39:18.465916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 496/958] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:39:18 2022] DELETE /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:39:18.475015 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c991464f-a3e7-403a-8575-ae8cbcd08672 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:18.475955 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c991464f-a3e7-403a-8575-ae8cbcd08672 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:18.482040 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c991464f-a3e7-403a-8575-ae8cbcd08672 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:18.482580 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c991464f-a3e7-403a-8575-ae8cbcd08672 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:18.483025 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c991464f-a3e7-403a-8575-ae8cbcd08672 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:18.483720 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c991464f-a3e7-403a-8575-ae8cbcd08672 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:18.484180 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c991464f-a3e7-403a-8575-ae8cbcd08672 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:18.484610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c991464f-a3e7-403a-8575-ae8cbcd08672 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:18.611141 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c991464f-a3e7-403a-8575-ae8cbcd08672 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:18.618978 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c991464f-a3e7-403a-8575-ae8cbcd08672 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1555 microversion: 2.1 time: 0.148840 Sep 03 01:39:18.619546 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 463/959] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:18 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:19.360269 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0679a599-5f2e-48a3-a1b7-b2dfa0ce4413 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:19.360978 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0679a599-5f2e-48a3-a1b7-b2dfa0ce4413 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:19.367743 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0679a599-5f2e-48a3-a1b7-b2dfa0ce4413 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:19.368172 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0679a599-5f2e-48a3-a1b7-b2dfa0ce4413 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:19.368607 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0679a599-5f2e-48a3-a1b7-b2dfa0ce4413 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:19.369301 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0679a599-5f2e-48a3-a1b7-b2dfa0ce4413 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:19.369754 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0679a599-5f2e-48a3-a1b7-b2dfa0ce4413 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:19.370179 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0679a599-5f2e-48a3-a1b7-b2dfa0ce4413 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:19.503946 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0679a599-5f2e-48a3-a1b7-b2dfa0ce4413 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:19.512231 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0679a599-5f2e-48a3-a1b7-b2dfa0ce4413 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1680 microversion: 2.1 time: 0.156255 Sep 03 01:39:19.512825 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 497/960] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:19 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:19.642764 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ee9226ac-51cc-44b7-bada-a449219b8662 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:19.643374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ee9226ac-51cc-44b7-bada-a449219b8662 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:19.649889 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ee9226ac-51cc-44b7-bada-a449219b8662 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:19.650393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ee9226ac-51cc-44b7-bada-a449219b8662 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:19.650838 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ee9226ac-51cc-44b7-bada-a449219b8662 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:19.651523 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ee9226ac-51cc-44b7-bada-a449219b8662 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:19.651977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ee9226ac-51cc-44b7-bada-a449219b8662 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:19.652402 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ee9226ac-51cc-44b7-bada-a449219b8662 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:19.781908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ee9226ac-51cc-44b7-bada-a449219b8662 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:19.790144 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ee9226ac-51cc-44b7-bada-a449219b8662 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1555 microversion: 2.1 time: 0.151247 Sep 03 01:39:19.790738 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 464/961] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:19 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:20.536265 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-05ab33cf-f2a2-4f0e-af71-4be2befab10b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:20.536799 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-05ab33cf-f2a2-4f0e-af71-4be2befab10b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:20.539589 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:20.544299 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-05ab33cf-f2a2-4f0e-af71-4be2befab10b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:20.544790 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-05ab33cf-f2a2-4f0e-af71-4be2befab10b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:20.545229 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-05ab33cf-f2a2-4f0e-af71-4be2befab10b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:20.545928 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-05ab33cf-f2a2-4f0e-af71-4be2befab10b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:20.546407 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-05ab33cf-f2a2-4f0e-af71-4be2befab10b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:20.546839 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-05ab33cf-f2a2-4f0e-af71-4be2befab10b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:20.678263 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-05ab33cf-f2a2-4f0e-af71-4be2befab10b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:20.685836 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-05ab33cf-f2a2-4f0e-af71-4be2befab10b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1680 microversion: 2.1 time: 0.153757 Sep 03 01:39:20.686423 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 498/962] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:20 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:20.813034 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5590f614-70a7-4e3c-af5b-fc4e105040db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:20.813626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5590f614-70a7-4e3c-af5b-fc4e105040db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:20.816339 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=66 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:20.821678 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5590f614-70a7-4e3c-af5b-fc4e105040db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:20.822221 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5590f614-70a7-4e3c-af5b-fc4e105040db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:20.838748 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5590f614-70a7-4e3c-af5b-fc4e105040db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:20.838748 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5590f614-70a7-4e3c-af5b-fc4e105040db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:20.838748 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5590f614-70a7-4e3c-af5b-fc4e105040db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:20.838748 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5590f614-70a7-4e3c-af5b-fc4e105040db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:20.954597 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5590f614-70a7-4e3c-af5b-fc4e105040db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:20.962261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5590f614-70a7-4e3c-af5b-fc4e105040db tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1555 microversion: 2.1 time: 0.153109 Sep 03 01:39:20.962868 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 465/963] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:20 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:21.709705 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d42d1f59-d848-4dc3-b37d-f84d67e3d411 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:21.710245 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d42d1f59-d848-4dc3-b37d-f84d67e3d411 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:21.717591 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d42d1f59-d848-4dc3-b37d-f84d67e3d411 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:21.718168 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d42d1f59-d848-4dc3-b37d-f84d67e3d411 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:21.718632 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d42d1f59-d848-4dc3-b37d-f84d67e3d411 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:21.719322 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d42d1f59-d848-4dc3-b37d-f84d67e3d411 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:21.719773 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d42d1f59-d848-4dc3-b37d-f84d67e3d411 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:21.720199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d42d1f59-d848-4dc3-b37d-f84d67e3d411 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:21.852129 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d42d1f59-d848-4dc3-b37d-f84d67e3d411 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:21.859903 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d42d1f59-d848-4dc3-b37d-f84d67e3d411 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1680 microversion: 2.1 time: 0.154141 Sep 03 01:39:21.860468 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 499/964] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:21 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:21.986005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-77702ea2-2808-4ca4-a364-3c9221d719ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:21.986568 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-77702ea2-2808-4ca4-a364-3c9221d719ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:21.993629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77702ea2-2808-4ca4-a364-3c9221d719ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:21.994117 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77702ea2-2808-4ca4-a364-3c9221d719ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:21.994585 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77702ea2-2808-4ca4-a364-3c9221d719ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:21.995278 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77702ea2-2808-4ca4-a364-3c9221d719ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:21.995737 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77702ea2-2808-4ca4-a364-3c9221d719ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:21.996180 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77702ea2-2808-4ca4-a364-3c9221d719ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:22.014735 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:22.128586 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-77702ea2-2808-4ca4-a364-3c9221d719ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:22.137260 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-77702ea2-2808-4ca4-a364-3c9221d719ee tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1555 microversion: 2.1 time: 0.155159 Sep 03 01:39:22.137827 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 466/965] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:21 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:22.888394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-14932dc0-be74-4e9a-a3d0-cd100cd0eb0d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:22.889001 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-14932dc0-be74-4e9a-a3d0-cd100cd0eb0d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:22.895353 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14932dc0-be74-4e9a-a3d0-cd100cd0eb0d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:22.895834 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14932dc0-be74-4e9a-a3d0-cd100cd0eb0d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:22.896268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14932dc0-be74-4e9a-a3d0-cd100cd0eb0d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:22.896952 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14932dc0-be74-4e9a-a3d0-cd100cd0eb0d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:22.897399 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14932dc0-be74-4e9a-a3d0-cd100cd0eb0d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:22.897822 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14932dc0-be74-4e9a-a3d0-cd100cd0eb0d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:23.035394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-14932dc0-be74-4e9a-a3d0-cd100cd0eb0d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:23.043637 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-14932dc0-be74-4e9a-a3d0-cd100cd0eb0d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1680 microversion: 2.1 time: 0.159074 Sep 03 01:39:23.044207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 500/966] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:22 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:23.160600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-765b49ff-ac47-498a-ac3e-926028dcf2f0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:23.161208 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-765b49ff-ac47-498a-ac3e-926028dcf2f0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:23.167959 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-765b49ff-ac47-498a-ac3e-926028dcf2f0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:23.168436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-765b49ff-ac47-498a-ac3e-926028dcf2f0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:23.168897 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-765b49ff-ac47-498a-ac3e-926028dcf2f0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:23.169576 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-765b49ff-ac47-498a-ac3e-926028dcf2f0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:23.170020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-765b49ff-ac47-498a-ac3e-926028dcf2f0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:23.170464 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-765b49ff-ac47-498a-ac3e-926028dcf2f0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:23.313006 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-765b49ff-ac47-498a-ac3e-926028dcf2f0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:23.321392 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-765b49ff-ac47-498a-ac3e-926028dcf2f0 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1555 microversion: 2.1 time: 0.164834 Sep 03 01:39:23.321910 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 467/967] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:23 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:24.067791 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-54b2cfe5-98f3-4c99-8a03-c7ede8e0b0a6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:24.068535 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-54b2cfe5-98f3-4c99-8a03-c7ede8e0b0a6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:24.076655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54b2cfe5-98f3-4c99-8a03-c7ede8e0b0a6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:24.077175 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54b2cfe5-98f3-4c99-8a03-c7ede8e0b0a6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:24.077672 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54b2cfe5-98f3-4c99-8a03-c7ede8e0b0a6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:24.078908 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54b2cfe5-98f3-4c99-8a03-c7ede8e0b0a6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:24.079014 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54b2cfe5-98f3-4c99-8a03-c7ede8e0b0a6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:24.079489 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54b2cfe5-98f3-4c99-8a03-c7ede8e0b0a6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:24.214024 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-54b2cfe5-98f3-4c99-8a03-c7ede8e0b0a6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:24.221672 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-54b2cfe5-98f3-4c99-8a03-c7ede8e0b0a6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1680 microversion: 2.1 time: 0.158537 Sep 03 01:39:24.222249 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 501/968] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:24 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:24.344493 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7cbb8971-96fb-4df7-a260-ea613415a453 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:24.345021 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7cbb8971-96fb-4df7-a260-ea613415a453 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:24.352277 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7cbb8971-96fb-4df7-a260-ea613415a453 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:24.352776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7cbb8971-96fb-4df7-a260-ea613415a453 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:24.353216 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7cbb8971-96fb-4df7-a260-ea613415a453 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:24.353905 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7cbb8971-96fb-4df7-a260-ea613415a453 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:24.354383 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7cbb8971-96fb-4df7-a260-ea613415a453 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:24.354812 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7cbb8971-96fb-4df7-a260-ea613415a453 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:24.482714 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7cbb8971-96fb-4df7-a260-ea613415a453 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:24.490760 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7cbb8971-96fb-4df7-a260-ea613415a453 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1555 microversion: 2.1 time: 0.150444 Sep 03 01:39:24.491332 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 468/969] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:24 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:25.247521 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-91155ddc-f359-42b2-845a-d00dc04b3e75 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:25.248186 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-91155ddc-f359-42b2-845a-d00dc04b3e75 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:25.255797 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-91155ddc-f359-42b2-845a-d00dc04b3e75 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:25.256288 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-91155ddc-f359-42b2-845a-d00dc04b3e75 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:25.263139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-91155ddc-f359-42b2-845a-d00dc04b3e75 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:25.263139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-91155ddc-f359-42b2-845a-d00dc04b3e75 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:25.263139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-91155ddc-f359-42b2-845a-d00dc04b3e75 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:25.263139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-91155ddc-f359-42b2-845a-d00dc04b3e75 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:25.410168 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-91155ddc-f359-42b2-845a-d00dc04b3e75 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:25.419305 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-91155ddc-f359-42b2-845a-d00dc04b3e75 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1680 microversion: 2.1 time: 0.177207 Sep 03 01:39:25.419931 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 502/970] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:25 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1680 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:25.513903 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-93fa6928-ced1-4c7e-9bc3-a6b0302a3110 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:25.514716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-93fa6928-ced1-4c7e-9bc3-a6b0302a3110 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:25.521740 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93fa6928-ced1-4c7e-9bc3-a6b0302a3110 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:25.524953 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93fa6928-ced1-4c7e-9bc3-a6b0302a3110 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:25.524953 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93fa6928-ced1-4c7e-9bc3-a6b0302a3110 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:25.524953 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93fa6928-ced1-4c7e-9bc3-a6b0302a3110 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:25.524953 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93fa6928-ced1-4c7e-9bc3-a6b0302a3110 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:25.525425 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93fa6928-ced1-4c7e-9bc3-a6b0302a3110 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:25.683650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-93fa6928-ced1-4c7e-9bc3-a6b0302a3110 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:25.691825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-93fa6928-ced1-4c7e-9bc3-a6b0302a3110 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1555 microversion: 2.1 time: 0.182344 Sep 03 01:39:25.692388 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 469/971] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:25 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1555 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:26.444519 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0288f4c2-079f-4d87-a0c7-1eb61754ed57 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:26.445391 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0288f4c2-079f-4d87-a0c7-1eb61754ed57 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:26.451967 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0288f4c2-079f-4d87-a0c7-1eb61754ed57 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:26.452430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0288f4c2-079f-4d87-a0c7-1eb61754ed57 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:26.457024 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0288f4c2-079f-4d87-a0c7-1eb61754ed57 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:26.457024 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0288f4c2-079f-4d87-a0c7-1eb61754ed57 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:26.457024 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0288f4c2-079f-4d87-a0c7-1eb61754ed57 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:26.457024 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0288f4c2-079f-4d87-a0c7-1eb61754ed57 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:26.673985 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0288f4c2-079f-4d87-a0c7-1eb61754ed57 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:26.682629 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0288f4c2-079f-4d87-a0c7-1eb61754ed57 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1680 microversion: 2.1 time: 0.241841 Sep 03 01:39:26.683326 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 503/972] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:26 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1680 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:26.726537 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d6eaa3ff-ec3a-4b97-8a64-b15ec0adb14a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:26.726537 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d6eaa3ff-ec3a-4b97-8a64-b15ec0adb14a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:26.727377 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d6eaa3ff-ec3a-4b97-8a64-b15ec0adb14a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:26.727377 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d6eaa3ff-ec3a-4b97-8a64-b15ec0adb14a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:26.727619 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d6eaa3ff-ec3a-4b97-8a64-b15ec0adb14a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:26.728239 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d6eaa3ff-ec3a-4b97-8a64-b15ec0adb14a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:26.728688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d6eaa3ff-ec3a-4b97-8a64-b15ec0adb14a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:26.729111 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d6eaa3ff-ec3a-4b97-8a64-b15ec0adb14a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:26.979884 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d6eaa3ff-ec3a-4b97-8a64-b15ec0adb14a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:26.988982 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d6eaa3ff-ec3a-4b97-8a64-b15ec0adb14a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1555 microversion: 2.1 time: 0.273836 Sep 03 01:39:26.999575 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 470/973] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:26 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1555 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:27.112430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-af275669-8dcd-4433-af00-e46ef3ccac07 req-fe1d0ad7-216c-4459-965f-8615a91309ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5df2d41-c884-4178-9a70-150c16cf1c5f", "name": "network-vif-deleted", "tag": "f1b93106-790d-4f9d-9fae-cd59eef8bc20"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:39:27.121891 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-af275669-8dcd-4433-af00-e46ef3ccac07 req-fe1d0ad7-216c-4459-965f-8615a91309ab service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:27.122381 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-af275669-8dcd-4433-af00-e46ef3ccac07 req-fe1d0ad7-216c-4459-965f-8615a91309ab service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:27.122814 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-af275669-8dcd-4433-af00-e46ef3ccac07 req-fe1d0ad7-216c-4459-965f-8615a91309ab service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:27.133638 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-af275669-8dcd-4433-af00-e46ef3ccac07 req-fe1d0ad7-216c-4459-965f-8615a91309ab service nova] Creating event network-vif-deleted:f1b93106-790d-4f9d-9fae-cd59eef8bc20 for instance e5df2d41-c884-4178-9a70-150c16cf1c5f on hv-cinder-83800 Sep 03 01:39:27.138556 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-af275669-8dcd-4433-af00-e46ef3ccac07 req-fe1d0ad7-216c-4459-965f-8615a91309ab service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029898 Sep 03 01:39:27.139139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 504/974] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:27.560936 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-fdeb854b-e3d7-4f9d-a857-d63a97a6e753 req-14171018-51ce-4e71-8d31-84363e52b20b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fb78ff3-5840-45d5-8185-450243588142", "name": "network-vif-deleted", "tag": "d45b0a37-c43a-46e4-8121-1008ccf616f3"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:39:27.572409 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-fdeb854b-e3d7-4f9d-a857-d63a97a6e753 req-14171018-51ce-4e71-8d31-84363e52b20b service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:27.573154 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-fdeb854b-e3d7-4f9d-a857-d63a97a6e753 req-14171018-51ce-4e71-8d31-84363e52b20b service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:27.573734 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-fdeb854b-e3d7-4f9d-a857-d63a97a6e753 req-14171018-51ce-4e71-8d31-84363e52b20b service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:27.593604 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-fdeb854b-e3d7-4f9d-a857-d63a97a6e753 req-14171018-51ce-4e71-8d31-84363e52b20b service nova] Creating event network-vif-deleted:d45b0a37-c43a-46e4-8121-1008ccf616f3 for instance 3fb78ff3-5840-45d5-8185-450243588142 on hv-cinder-83800 Sep 03 01:39:27.597950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-fdeb854b-e3d7-4f9d-a857-d63a97a6e753 req-14171018-51ce-4e71-8d31-84363e52b20b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041264 Sep 03 01:39:27.604676 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 471/975] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:27.630901 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8d3f446f-a51b-4df4-abbd-b3973aa1a134 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:27.631578 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-8d3f446f-a51b-4df4-abbd-b3973aa1a134 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:27.640626 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8d3f446f-a51b-4df4-abbd-b3973aa1a134 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:27.641129 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8d3f446f-a51b-4df4-abbd-b3973aa1a134 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:27.647467 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8d3f446f-a51b-4df4-abbd-b3973aa1a134 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:27.648961 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8d3f446f-a51b-4df4-abbd-b3973aa1a134 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:27.653394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8d3f446f-a51b-4df4-abbd-b3973aa1a134 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:27.653394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8d3f446f-a51b-4df4-abbd-b3973aa1a134 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:27.708492 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-618824d8-b512-462e-b607-db446bdf6a02 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:27.709465 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-618824d8-b512-462e-b607-db446bdf6a02 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:27.718302 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-618824d8-b512-462e-b607-db446bdf6a02 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:27.719057 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-618824d8-b512-462e-b607-db446bdf6a02 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:27.719708 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-618824d8-b512-462e-b607-db446bdf6a02 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:27.720799 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-618824d8-b512-462e-b607-db446bdf6a02 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:27.721627 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-618824d8-b512-462e-b607-db446bdf6a02 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:27.722252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-618824d8-b512-462e-b607-db446bdf6a02 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:27.788102 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-8d3f446f-a51b-4df4-abbd-b3973aa1a134 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lazy-loading 'services' on Instance uuid 6b38d9e1-6eef-468f-82e1-a96d8d28214c {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:39:27.855251 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-618824d8-b512-462e-b607-db446bdf6a02 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:27.867292 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-618824d8-b512-462e-b607-db446bdf6a02 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1325 microversion: 2.1 time: 0.163679 Sep 03 01:39:27.868031 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 472/976] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:27 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1325 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:39:28.013710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:28.014425 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:28.020479 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:28.020970 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:28.021416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:28.022116 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:28.022600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:28.023136 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:28.054477 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:28.054973 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:28.055512 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:28.055973 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lazy-loading 'fault' on Instance uuid e5df2d41-c884-4178-9a70-150c16cf1c5f {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:39:28.088357 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-8d3f446f-a51b-4df4-abbd-b3973aa1a134 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c/os-volume_attachments/0a7702fb-6f3c-44ef-9fac-8486fe21d9e6" status: 202 len: 0 microversion: 2.1 time: 0.466877 Sep 03 01:39:28.088875 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 505/977] 10.222.0.13 () {58 vars in 1416 bytes} [Sat Sep 3 01:39:27 2022] DELETE /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c/os-volume_attachments/0a7702fb-6f3c-44ef-9fac-8486fe21d9e6 => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:39:28.101661 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b8349bd45ad84f14858f73bf42b48380', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '364812df6abf492698453972e9a1d120', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:28.110422 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-96e0c86f-17a2-4245-bf64-20aa3a2c0f4a tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 200 len: 1348 microversion: 2.1 time: 0.100349 Sep 03 01:39:28.111223 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 473/978] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:28 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 1348 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:39:28.893247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:28.893943 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:28.901130 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:28.901617 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:28.902056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:28.902844 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:28.903293 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:28.903715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:28.939882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:28.940270 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:28.940696 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:28.941136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lazy-loading 'fault' on Instance uuid 3fb78ff3-5840-45d5-8185-450243588142 {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:39:28.986327 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:28.994593 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-bcec3659-c100-4d7b-b24e-e299ac6f34b5 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 200 len: 1330 microversion: 2.1 time: 0.106259 Sep 03 01:39:28.995159 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 506/979] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:28 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:29.140471 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9f92f73b-ac2b-416d-bd43-680c1d2a8ad7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:29.141157 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9f92f73b-ac2b-416d-bd43-680c1d2a8ad7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] [instance: e5df2d41-c884-4178-9a70-150c16cf1c5f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:29.149609 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f92f73b-ac2b-416d-bd43-680c1d2a8ad7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:29.150087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f92f73b-ac2b-416d-bd43-680c1d2a8ad7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:29.150562 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f92f73b-ac2b-416d-bd43-680c1d2a8ad7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:29.151454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f92f73b-ac2b-416d-bd43-680c1d2a8ad7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:29.151912 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f92f73b-ac2b-416d-bd43-680c1d2a8ad7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:29.152338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9f92f73b-ac2b-416d-bd43-680c1d2a8ad7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:29.166953 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-9f92f73b-ac2b-416d-bd43-680c1d2a8ad7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] HTTP exception thrown: Instance e5df2d41-c884-4178-9a70-150c16cf1c5f could not be found. Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9f92f73b-ac2b-416d-bd43-680c1d2a8ad7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Request method failure captured: Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f HTTP/1.1 Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq9lR3_wcVialq5XMuMg7kcvdeQrirJg5m4vGDSIEknDPca7HbNjF6bYyqAl7nDUw1oe0cUnAaAaFjIrwxrUvS6IgZGN_gRcntgVbsSj7E1l3ALhvDFV3cGm-h3TRbttQS8XG2qI9cKj6P0IBsvR0t_LpR0nxbMeEsEXFer1dwAlXjg Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 364812df6abf492698453972e9a1d120 Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-TestMinimumBasicScenario-1297237569 Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:39:29.168705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:39:29.170005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_364812df6abf492698453972e9a1d120"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/364812df6abf492698453972e9a1d120"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/364812df6abf492698453972e9a1d120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/364812df6abf492698453972e9a1d120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:39:29.170005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-TestMinimumBasicScenario-1297237569 Sep 03 01:39:29.170005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 364812df6abf492698453972e9a1d120 Sep 03 01:39:29.170005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1297237569 Sep 03 01:39:29.170005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-TestMinimumBasicScenario-1297237569-project Sep 03 01:39:29.170005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:39:29.170005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:39:29.170005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: b8349bd45ad84f14858f73bf42b48380 Sep 03 01:39:29.170005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-TestMinimumBasicScenario-1297237569-project Sep 03 01:39:29.170005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:39:29.170005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance e5df2d41-c884-4178-9a70-150c16cf1c5f could not be found. Sep 03 01:39:29.170005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': 'e5df2d41-c884-4178-9a70-150c16cf1c5f'} Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5df2d41-c884-4178-9a70-150c16cf1c5f could not be found. Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:39:29.170787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5df2d41-c884-4178-9a70-150c16cf1c5f could not be found. Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5df2d41-c884-4178-9a70-150c16cf1c5f could not be found. Sep 03 01:39:29.172113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:29.173809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9f92f73b-ac2b-416d-bd43-680c1d2a8ad7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Returning 404 to user: Instance e5df2d41-c884-4178-9a70-150c16cf1c5f could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:39:29.173809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9f92f73b-ac2b-416d-bd43-680c1d2a8ad7 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f" status: 404 len: 111 microversion: 2.1 time: 0.035473 Sep 03 01:39:29.173809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 474/980] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:29 2022] GET /compute/v2.1/servers/e5df2d41-c884-4178-9a70-150c16cf1c5f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:39:29.179446 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-eb7ea894-6a11-4907-98ed-a3aa66e9e295 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] Calling method '.version_select at 0x7f6d280e8b80>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:29.244283 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-eb7ea894-6a11-4907-98ed-a3aa66e9e295 tempest-TestMinimumBasicScenario-1297237569 tempest-TestMinimumBasicScenario-1297237569-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2015649541" status: 202 len: 0 microversion: 2.1 time: 0.068710 Sep 03 01:39:29.245161 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 507/981] 10.222.0.13 () {58 vars in 1272 bytes} [Sat Sep 3 01:39:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-2015649541 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:39:30.017436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7445989c-f91e-40b6-b917-5ec91819e604 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:30.018054 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7445989c-f91e-40b6-b917-5ec91819e604 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:30.024235 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7445989c-f91e-40b6-b917-5ec91819e604 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:30.024728 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7445989c-f91e-40b6-b917-5ec91819e604 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:30.025168 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7445989c-f91e-40b6-b917-5ec91819e604 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:30.025857 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7445989c-f91e-40b6-b917-5ec91819e604 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:30.026312 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7445989c-f91e-40b6-b917-5ec91819e604 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:30.026764 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7445989c-f91e-40b6-b917-5ec91819e604 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:30.040854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-7445989c-f91e-40b6-b917-5ec91819e604 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7445989c-f91e-40b6-b917-5ec91819e604 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 HTTP/1.1 Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:39:30.042417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:39:30.044090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:39:30.044090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:39:30.044090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:39:30.044090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:39:30.044090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:39:30.044090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:39:30.044090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:39:30.044090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:39:30.044090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:39:30.044090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:39:30.044090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:39:30.044090 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '3fb78ff3-5840-45d5-8185-450243588142'} Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:39:30.045204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:39:30.046744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:30.048080 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7445989c-f91e-40b6-b917-5ec91819e604 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 404 to user: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:39:30.048080 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7445989c-f91e-40b6-b917-5ec91819e604 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 404 len: 111 microversion: 2.1 time: 0.030245 Sep 03 01:39:30.048080 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 475/982] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:30 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:39:30.053490 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-538a4ca7-6f60-4f4c-9bd7-b5e9f0b4ca2f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '.version_select at 0x7f6d280c9700>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:30.164264 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-538a4ca7-6f60-4f4c-9bd7-b5e9f0b4ca2f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-787952500" status: 202 len: 0 microversion: 2.1 time: 0.115228 Sep 03 01:39:30.164859 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 508/983] 10.222.0.13 () {58 vars in 1218 bytes} [Sat Sep 3 01:39:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-787952500 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 01:39:30.426221 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7eaea348-ba3c-4897-aa1f-123ab75c5485 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:30.426824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7eaea348-ba3c-4897-aa1f-123ab75c5485 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:30.433312 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7eaea348-ba3c-4897-aa1f-123ab75c5485 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:30.433793 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7eaea348-ba3c-4897-aa1f-123ab75c5485 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:30.434225 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7eaea348-ba3c-4897-aa1f-123ab75c5485 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:30.434939 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7eaea348-ba3c-4897-aa1f-123ab75c5485 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:30.435394 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7eaea348-ba3c-4897-aa1f-123ab75c5485 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:30.435819 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7eaea348-ba3c-4897-aa1f-123ab75c5485 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:30.461956 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7eaea348-ba3c-4897-aa1f-123ab75c5485 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:39:30.828031 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7eaea348-ba3c-4897-aa1f-123ab75c5485 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "DELETE /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 204 len: 0 microversion: 2.1 time: 0.404388 Sep 03 01:39:30.830695 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 476/984] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:39:30 2022] DELETE /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:39:30.838789 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0f9ceaf2-15d2-43c2-9ae2-4e99a025e6b3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:30.839410 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0f9ceaf2-15d2-43c2-9ae2-4e99a025e6b3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:30.858395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f9ceaf2-15d2-43c2-9ae2-4e99a025e6b3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:30.858893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f9ceaf2-15d2-43c2-9ae2-4e99a025e6b3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:30.859607 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f9ceaf2-15d2-43c2-9ae2-4e99a025e6b3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:30.860016 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f9ceaf2-15d2-43c2-9ae2-4e99a025e6b3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:30.860472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f9ceaf2-15d2-43c2-9ae2-4e99a025e6b3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:30.860893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0f9ceaf2-15d2-43c2-9ae2-4e99a025e6b3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:31.105574 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0f9ceaf2-15d2-43c2-9ae2-4e99a025e6b3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:31.115494 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0f9ceaf2-15d2-43c2-9ae2-4e99a025e6b3 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1514 microversion: 2.1 time: 0.280670 Sep 03 01:39:31.131497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 509/985] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:30 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1514 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:31.476278 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-857f4e40-0b7c-471d-bcd3-5cdc457b8ef7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Action: 'create', calling method: .version_select at 0x7f6d249d90d0>, body: {"keypair": {"name": "tempest-keypair-1242611918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFRiYX54N/3tzfbF4pG2XkKSiersSCYQIyBTMzwigFuc8GqgsHVobBpjQaipTlNb+ehBpyTgjrnE2sxmomD42ACHyrz6IMrNdIjPm8GRFCf5BEe3qw2uJ7+HTgCby1jYIg=="}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:39:31.491571 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-857f4e40-0b7c-471d-bcd3-5cdc457b8ef7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for project 02813cf0683749ee87b039b28f1aeebb. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:39:31.495511 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-857f4e40-0b7c-471d-bcd3-5cdc457b8ef7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for user 2b9ab1983bb84318b509878b930e9402 and project 02813cf0683749ee87b039b28f1aeebb. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:39:31.587216 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-857f4e40-0b7c-471d-bcd3-5cdc457b8ef7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.115695 Sep 03 01:39:31.587836 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 477/986] 10.222.0.13 () {60 vars in 1159 bytes} [Sat Sep 3 01:39:31 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:32.141115 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3cc04121-37f7-46eb-8523-e43cd1434507 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:32.142255 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-3cc04121-37f7-46eb-8523-e43cd1434507 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:32.157601 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3cc04121-37f7-46eb-8523-e43cd1434507 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:32.171451 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3cc04121-37f7-46eb-8523-e43cd1434507 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:32.171451 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3cc04121-37f7-46eb-8523-e43cd1434507 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:32.171451 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3cc04121-37f7-46eb-8523-e43cd1434507 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:32.171451 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3cc04121-37f7-46eb-8523-e43cd1434507 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:32.171947 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3cc04121-37f7-46eb-8523-e43cd1434507 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:32.333998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-3cc04121-37f7-46eb-8523-e43cd1434507 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:32.346165 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3cc04121-37f7-46eb-8523-e43cd1434507 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1514 microversion: 2.1 time: 0.208823 Sep 03 01:39:32.347110 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 510/987] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:32 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1514 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:33.379721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6b444321-6b4d-419b-8a03-3bd14bcf02ed tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:33.382309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-a05d6013-fe01-4751-b24f-b655fac0b421 req-fa2f0c80-cc05-41de-8074-4ae1e4ae8c5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b38d9e1-6eef-468f-82e1-a96d8d28214c", "name": "network-vif-deleted", "tag": "768a2c50-eeb8-48ba-885e-1eab0487f58f"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:39:33.383656 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6b444321-6b4d-419b-8a03-3bd14bcf02ed tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:33.410473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6b444321-6b4d-419b-8a03-3bd14bcf02ed tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:33.410473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6b444321-6b4d-419b-8a03-3bd14bcf02ed tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:33.410473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6b444321-6b4d-419b-8a03-3bd14bcf02ed tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:33.411885 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6b444321-6b4d-419b-8a03-3bd14bcf02ed tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:33.415023 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6b444321-6b4d-419b-8a03-3bd14bcf02ed tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:33.415681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6b444321-6b4d-419b-8a03-3bd14bcf02ed tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:33.424436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-a05d6013-fe01-4751-b24f-b655fac0b421 req-fa2f0c80-cc05-41de-8074-4ae1e4ae8c5c service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:33.428616 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-a05d6013-fe01-4751-b24f-b655fac0b421 req-fa2f0c80-cc05-41de-8074-4ae1e4ae8c5c service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:33.430015 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-a05d6013-fe01-4751-b24f-b655fac0b421 req-fa2f0c80-cc05-41de-8074-4ae1e4ae8c5c service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:33.471203 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-a05d6013-fe01-4751-b24f-b655fac0b421 req-fa2f0c80-cc05-41de-8074-4ae1e4ae8c5c service nova] Creating event network-vif-deleted:768a2c50-eeb8-48ba-885e-1eab0487f58f for instance 6b38d9e1-6eef-468f-82e1-a96d8d28214c on hv-cinder-83800 Sep 03 01:39:33.487258 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-a05d6013-fe01-4751-b24f-b655fac0b421 req-fa2f0c80-cc05-41de-8074-4ae1e4ae8c5c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118201 Sep 03 01:39:33.488793 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 478/988] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:33.583170 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6b444321-6b4d-419b-8a03-3bd14bcf02ed tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:33.595150 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6b444321-6b4d-419b-8a03-3bd14bcf02ed tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1472 microversion: 2.1 time: 0.226927 Sep 03 01:39:33.606459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 511/989] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:33 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:34.620748 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:34.621513 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:34.628482 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:34.629109 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:34.629739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:34.630634 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:34.631304 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:34.631886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:34.668043 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:34.668559 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:34.669184 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:34.669633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lazy-loading 'fault' on Instance uuid 6b38d9e1-6eef-468f-82e1-a96d8d28214c {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:39:34.711850 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '69028bf5296541b6bfe9595d684c6567', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efb12fa605334996a0e25888c90a108a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:34.723418 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7404ea11-046b-42be-8f78-ed6e8846cfb6 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 200 len: 1309 microversion: 2.1 time: 0.104031 Sep 03 01:39:34.723418 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 479/990] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:34 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:35.148748 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1370922108", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7bd92e7f-f880-47a6-a573-413ea7d8bd54"}], "security_groups": [{"name": "tempest-securitygroup--2115657419"}], "key_name": "tempest-keypair-1242611918", "user_data": "}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:39:35.266932 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.network.neutron [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] validate_networks() for [('7bd92e7f-f880-47a6-a573-413ea7d8bd54', None, None, None, None, None)] {{(pid=127552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:39:35.676939 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Flavor limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:39:35.677357 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Image limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:39:35.677827 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Flavor pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:39:35.678257 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Image pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:39:35.678789 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:39:35.687449 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:35.687928 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:35.688358 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:35.689080 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:35.689521 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:35.689942 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:35.708466 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for project 02813cf0683749ee87b039b28f1aeebb. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:39:35.716988 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Getting quotas for user 2b9ab1983bb84318b509878b930e9402 and project 02813cf0683749ee87b039b28f1aeebb. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:39:35.729483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Going to run 1 instances... {{(pid=127552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:39:35.732458 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:39:35.744489 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-59b58cc1-0b94-421e-8c28-43dd81764119 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:35.744956 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-59b58cc1-0b94-421e-8c28-43dd81764119 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] [instance: 6b38d9e1-6eef-468f-82e1-a96d8d28214c] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:35.754252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-59b58cc1-0b94-421e-8c28-43dd81764119 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:35.755170 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-59b58cc1-0b94-421e-8c28-43dd81764119 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:35.755841 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-59b58cc1-0b94-421e-8c28-43dd81764119 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:35.756800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-59b58cc1-0b94-421e-8c28-43dd81764119 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:35.757462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-59b58cc1-0b94-421e-8c28-43dd81764119 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:35.758170 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-59b58cc1-0b94-421e-8c28-43dd81764119 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:35.879160 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7a926da5-dd4b-4484-b20f-2c51791e3e1e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.727590 Sep 03 01:39:35.879160 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 512/991] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:39:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 03 01:39:35.887723 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2e3d9ce0-6200-48b2-b4cd-641c9f799431 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:35.888569 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2e3d9ce0-6200-48b2-b4cd-641c9f799431 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:35.939493 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-59b58cc1-0b94-421e-8c28-43dd81764119 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] HTTP exception thrown: Instance 6b38d9e1-6eef-468f-82e1-a96d8d28214c could not be found. Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-59b58cc1-0b94-421e-8c28-43dd81764119 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Request method failure captured: Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c HTTP/1.1 Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq-zpY9VpYsYtSWFChmJKWPC97HvlGUZS8YEArgQQg0k4Gzt7a8M5Z007EL36W-GO4YAPBsf5j_-5Bed_pKwtuLehqlyUyhuLJdtNGSvGEq5jJn8tXMfsUgVvx87EQV7cg3vxj40nbO1HpOrGQLoWj0rWkvoI2_3RduNY6xq44KRZsU Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: efb12fa605334996a0e25888c90a108a Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-VolumesSnapshotTestJSON-759650107 Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:39:35.941163 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:39:35.942816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_efb12fa605334996a0e25888c90a108a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/efb12fa605334996a0e25888c90a108a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/efb12fa605334996a0e25888c90a108a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/efb12fa605334996a0e25888c90a108a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:39:35.942816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-VolumesSnapshotTestJSON-759650107 Sep 03 01:39:35.942816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: efb12fa605334996a0e25888c90a108a Sep 03 01:39:35.942816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-759650107 Sep 03 01:39:35.942816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-VolumesSnapshotTestJSON-759650107-project Sep 03 01:39:35.942816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:39:35.942816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:39:35.942816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 69028bf5296541b6bfe9595d684c6567 Sep 03 01:39:35.942816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-VolumesSnapshotTestJSON-759650107-project Sep 03 01:39:35.942816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:39:35.942816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 6b38d9e1-6eef-468f-82e1-a96d8d28214c could not be found. Sep 03 01:39:35.942816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '6b38d9e1-6eef-468f-82e1-a96d8d28214c'} Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b38d9e1-6eef-468f-82e1-a96d8d28214c could not be found. Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:39:35.948236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b38d9e1-6eef-468f-82e1-a96d8d28214c could not be found. Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b38d9e1-6eef-468f-82e1-a96d8d28214c could not be found. Sep 03 01:39:35.949854 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:39:35.951057 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-59b58cc1-0b94-421e-8c28-43dd81764119 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] Returning 404 to user: Instance 6b38d9e1-6eef-468f-82e1-a96d8d28214c could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:39:35.951057 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-59b58cc1-0b94-421e-8c28-43dd81764119 tempest-VolumesSnapshotTestJSON-759650107 tempest-VolumesSnapshotTestJSON-759650107-project] 10.222.0.13 "GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c" status: 404 len: 111 microversion: 2.1 time: 0.202740 Sep 03 01:39:35.951057 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 480/992] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:35 2022] GET /compute/v2.1/servers/6b38d9e1-6eef-468f-82e1-a96d8d28214c => generated 111 bytes in 204 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:39:35.983505 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2e3d9ce0-6200-48b2-b4cd-641c9f799431 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:35.994186 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2e3d9ce0-6200-48b2-b4cd-641c9f799431 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1242 microversion: 2.1 time: 0.112819 Sep 03 01:39:36.000093 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 513/993] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:35 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:39:37.024601 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-276b18b2-6633-4157-9847-75ee4a6846a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:37.025215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-276b18b2-6633-4157-9847-75ee4a6846a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:37.032242 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-276b18b2-6633-4157-9847-75ee4a6846a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:37.034328 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-276b18b2-6633-4157-9847-75ee4a6846a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:37.034328 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-276b18b2-6633-4157-9847-75ee4a6846a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:37.034328 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-276b18b2-6633-4157-9847-75ee4a6846a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:37.034747 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-276b18b2-6633-4157-9847-75ee4a6846a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:37.035177 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-276b18b2-6633-4157-9847-75ee4a6846a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:37.096670 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-276b18b2-6633-4157-9847-75ee4a6846a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:37.105111 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-276b18b2-6633-4157-9847-75ee4a6846a1 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1246 microversion: 2.1 time: 0.084260 Sep 03 01:39:37.109194 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 481/994] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:37 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:39:38.129097 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-102fc1da-5f22-4282-8361-8ebecdb58074 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:38.130521 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-102fc1da-5f22-4282-8361-8ebecdb58074 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:38.138141 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-102fc1da-5f22-4282-8361-8ebecdb58074 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:38.138757 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-102fc1da-5f22-4282-8361-8ebecdb58074 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:38.139488 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-102fc1da-5f22-4282-8361-8ebecdb58074 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:38.140426 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-102fc1da-5f22-4282-8361-8ebecdb58074 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:38.141103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-102fc1da-5f22-4282-8361-8ebecdb58074 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:38.141749 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-102fc1da-5f22-4282-8361-8ebecdb58074 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:38.251365 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-102fc1da-5f22-4282-8361-8ebecdb58074 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:38.259546 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-102fc1da-5f22-4282-8361-8ebecdb58074 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1294 microversion: 2.1 time: 0.134353 Sep 03 01:39:38.260874 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 514/995] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:38 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1294 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:39.283154 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-403e494d-98c1-4815-a5db-581da49b5a07 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:39.284079 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-403e494d-98c1-4815-a5db-581da49b5a07 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:39.293860 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-403e494d-98c1-4815-a5db-581da49b5a07 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:39.295263 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-403e494d-98c1-4815-a5db-581da49b5a07 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:39.300401 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-403e494d-98c1-4815-a5db-581da49b5a07 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:39.302006 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-403e494d-98c1-4815-a5db-581da49b5a07 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:39.304709 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-403e494d-98c1-4815-a5db-581da49b5a07 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:39.305408 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-403e494d-98c1-4815-a5db-581da49b5a07 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:39.448080 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-403e494d-98c1-4815-a5db-581da49b5a07 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:39.457179 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-403e494d-98c1-4815-a5db-581da49b5a07 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1300 microversion: 2.1 time: 0.177914 Sep 03 01:39:39.457742 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 482/996] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:39 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1300 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:40.481118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5477d9be-b16e-46de-901f-99c616318837 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:40.481725 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5477d9be-b16e-46de-901f-99c616318837 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:40.488118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5477d9be-b16e-46de-901f-99c616318837 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:40.488648 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5477d9be-b16e-46de-901f-99c616318837 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:40.489034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5477d9be-b16e-46de-901f-99c616318837 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:40.489718 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5477d9be-b16e-46de-901f-99c616318837 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:40.490171 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5477d9be-b16e-46de-901f-99c616318837 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:40.490617 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5477d9be-b16e-46de-901f-99c616318837 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:40.510229 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:40.556561 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5477d9be-b16e-46de-901f-99c616318837 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:40.566133 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5477d9be-b16e-46de-901f-99c616318837 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1300 microversion: 2.1 time: 0.088811 Sep 03 01:39:40.570426 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 515/997] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:40 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1300 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:41.590085 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-26f4f8a6-dbd2-4da9-a550-f3df3761950d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:41.590745 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-26f4f8a6-dbd2-4da9-a550-f3df3761950d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:41.593170 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=4 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:41.597950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-26f4f8a6-dbd2-4da9-a550-f3df3761950d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:41.598631 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-26f4f8a6-dbd2-4da9-a550-f3df3761950d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:41.599073 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-26f4f8a6-dbd2-4da9-a550-f3df3761950d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:41.599756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-26f4f8a6-dbd2-4da9-a550-f3df3761950d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:41.600207 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-26f4f8a6-dbd2-4da9-a550-f3df3761950d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:41.600635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-26f4f8a6-dbd2-4da9-a550-f3df3761950d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:41.673196 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-26f4f8a6-dbd2-4da9-a550-f3df3761950d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:41.681916 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-26f4f8a6-dbd2-4da9-a550-f3df3761950d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1300 microversion: 2.1 time: 0.095715 Sep 03 01:39:41.682439 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 483/998] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:41 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1300 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:42.073068 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0d2d2cb9-b23e-4ed9-b4c5-287a3dbbfa6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:42.073608 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0d2d2cb9-b23e-4ed9-b4c5-287a3dbbfa6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:42.080376 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0d2d2cb9-b23e-4ed9-b4c5-287a3dbbfa6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:42.083140 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0d2d2cb9-b23e-4ed9-b4c5-287a3dbbfa6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:42.083140 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0d2d2cb9-b23e-4ed9-b4c5-287a3dbbfa6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:42.083140 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0d2d2cb9-b23e-4ed9-b4c5-287a3dbbfa6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:42.083140 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0d2d2cb9-b23e-4ed9-b4c5-287a3dbbfa6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:42.083665 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0d2d2cb9-b23e-4ed9-b4c5-287a3dbbfa6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:42.107600 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0d2d2cb9-b23e-4ed9-b4c5-287a3dbbfa6e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/ips" status: 200 len: 151 microversion: 2.20 time: 0.040163 Sep 03 01:39:42.108168 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 516/999] 10.222.0.13 () {60 vars in 1289 bytes} [Sat Sep 3 01:39:42 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:39:42.708002 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e320648d-5528-42e7-8937-7f17038eae68 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:42.716861 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e320648d-5528-42e7-8937-7f17038eae68 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:42.729945 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e320648d-5528-42e7-8937-7f17038eae68 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:42.729945 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e320648d-5528-42e7-8937-7f17038eae68 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:42.729945 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e320648d-5528-42e7-8937-7f17038eae68 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:42.729945 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e320648d-5528-42e7-8937-7f17038eae68 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:42.730307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e320648d-5528-42e7-8937-7f17038eae68 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:42.730307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e320648d-5528-42e7-8937-7f17038eae68 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:42.956313 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e320648d-5528-42e7-8937-7f17038eae68 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:42.964925 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e320648d-5528-42e7-8937-7f17038eae68 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1368 microversion: 2.1 time: 0.262436 Sep 03 01:39:42.965526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 484/1000] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:42 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:43.351917 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-1330595f-f2ac-405d-ae57-0a2b0c3ecceb req-980a04ef-7781-4642-96fc-9536bb765ab8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339527e0-bd33-4cfb-950f-ccb7a68a69bc", "tag": "914b4f37-4e68-434b-abc8-978883c344a6"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:39:43.363043 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-1330595f-f2ac-405d-ae57-0a2b0c3ecceb req-980a04ef-7781-4642-96fc-9536bb765ab8 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:43.369221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-1330595f-f2ac-405d-ae57-0a2b0c3ecceb req-980a04ef-7781-4642-96fc-9536bb765ab8 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:43.369221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-1330595f-f2ac-405d-ae57-0a2b0c3ecceb req-980a04ef-7781-4642-96fc-9536bb765ab8 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:43.376547 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-1330595f-f2ac-405d-ae57-0a2b0c3ecceb req-980a04ef-7781-4642-96fc-9536bb765ab8 service nova] Creating event network-changed:914b4f37-4e68-434b-abc8-978883c344a6 for instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc on hv-cinder-83800 Sep 03 01:39:43.381338 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-1330595f-f2ac-405d-ae57-0a2b0c3ecceb req-980a04ef-7781-4642-96fc-9536bb765ab8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033688 Sep 03 01:39:43.382948 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 517/1001] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:43.988752 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7f3bdef2-acb3-4818-a95d-af9cb8f937c6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:43.989375 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7f3bdef2-acb3-4818-a95d-af9cb8f937c6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:43.997801 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f3bdef2-acb3-4818-a95d-af9cb8f937c6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:43.998307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f3bdef2-acb3-4818-a95d-af9cb8f937c6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:43.998792 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f3bdef2-acb3-4818-a95d-af9cb8f937c6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:43.999703 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f3bdef2-acb3-4818-a95d-af9cb8f937c6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:44.000167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f3bdef2-acb3-4818-a95d-af9cb8f937c6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:44.000745 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7f3bdef2-acb3-4818-a95d-af9cb8f937c6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:44.005724 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:44.191114 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7f3bdef2-acb3-4818-a95d-af9cb8f937c6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:44.199024 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7f3bdef2-acb3-4818-a95d-af9cb8f937c6 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1368 microversion: 2.1 time: 0.214479 Sep 03 01:39:44.199593 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 485/1002] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:43 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:44.918884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a47ac5b3-6dee-4583-9fb1-641ae9ad8bee tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:39:44.919451 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a47ac5b3-6dee-4583-9fb1-641ae9ad8bee tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:44.925509 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a47ac5b3-6dee-4583-9fb1-641ae9ad8bee tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:44.925986 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a47ac5b3-6dee-4583-9fb1-641ae9ad8bee tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:44.926454 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a47ac5b3-6dee-4583-9fb1-641ae9ad8bee tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:44.927134 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a47ac5b3-6dee-4583-9fb1-641ae9ad8bee tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:44.927580 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a47ac5b3-6dee-4583-9fb1-641ae9ad8bee tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:44.927995 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a47ac5b3-6dee-4583-9fb1-641ae9ad8bee tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:44.951387 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-a47ac5b3-6dee-4583-9fb1-641ae9ad8bee tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lazy-loading 'flavor' on Instance uuid e156f97d-5465-4597-a836-c70692edfd41 {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:39:45.221114 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-23660d4e-45cd-4c36-a0f6-a8f21145bd3b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:45.221733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-23660d4e-45cd-4c36-a0f6-a8f21145bd3b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:45.228348 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-23660d4e-45cd-4c36-a0f6-a8f21145bd3b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:45.228833 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-23660d4e-45cd-4c36-a0f6-a8f21145bd3b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:45.229347 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-23660d4e-45cd-4c36-a0f6-a8f21145bd3b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:45.230013 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-23660d4e-45cd-4c36-a0f6-a8f21145bd3b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:45.230506 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-23660d4e-45cd-4c36-a0f6-a8f21145bd3b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:45.230934 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-23660d4e-45cd-4c36-a0f6-a8f21145bd3b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:45.364543 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-23660d4e-45cd-4c36-a0f6-a8f21145bd3b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:45.372791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-23660d4e-45cd-4c36-a0f6-a8f21145bd3b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1368 microversion: 2.1 time: 0.155455 Sep 03 01:39:45.373409 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 486/1003] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:45 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1368 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:39:45.374365 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a47ac5b3-6dee-4583-9fb1-641ae9ad8bee tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "POST /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/action" status: 202 len: 0 microversion: 2.20 time: 0.460117 Sep 03 01:39:45.378237 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 518/1004] 10.222.0.13 () {62 vars in 1319 bytes} [Sat Sep 3 01:39:44 2022] POST /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/action => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:39:45.394416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bab52ec7-1b32-4553-af04-c17fa8d67a18 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:45.395026 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bab52ec7-1b32-4553-af04-c17fa8d67a18 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:45.402057 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bab52ec7-1b32-4553-af04-c17fa8d67a18 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:45.402699 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bab52ec7-1b32-4553-af04-c17fa8d67a18 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:45.403301 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bab52ec7-1b32-4553-af04-c17fa8d67a18 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:45.404072 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bab52ec7-1b32-4553-af04-c17fa8d67a18 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:45.404620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bab52ec7-1b32-4553-af04-c17fa8d67a18 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:45.405137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bab52ec7-1b32-4553-af04-c17fa8d67a18 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:45.543324 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bab52ec7-1b32-4553-af04-c17fa8d67a18 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:45.554768 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bab52ec7-1b32-4553-af04-c17fa8d67a18 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:45.558563 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bab52ec7-1b32-4553-af04-c17fa8d67a18 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:45.559945 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bab52ec7-1b32-4553-af04-c17fa8d67a18 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.172468 Sep 03 01:39:45.560513 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 487/1005] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:39:45 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:39:45.581529 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e380bbd3-e325-47c8-85cb-bb3be0eb1259 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:45.582102 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e380bbd3-e325-47c8-85cb-bb3be0eb1259 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:45.588342 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e380bbd3-e325-47c8-85cb-bb3be0eb1259 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:45.588827 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e380bbd3-e325-47c8-85cb-bb3be0eb1259 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:45.589264 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e380bbd3-e325-47c8-85cb-bb3be0eb1259 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:45.589948 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e380bbd3-e325-47c8-85cb-bb3be0eb1259 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:45.590431 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e380bbd3-e325-47c8-85cb-bb3be0eb1259 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:45.590856 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e380bbd3-e325-47c8-85cb-bb3be0eb1259 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:45.616357 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e380bbd3-e325-47c8-85cb-bb3be0eb1259 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/ips" status: 200 len: 146 microversion: 2.1 time: 0.039086 Sep 03 01:39:45.616913 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 519/1006] 10.222.0.13 () {58 vars in 1248 bytes} [Sat Sep 3 01:39:45 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:46.401779 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d0caae93-9f78-48ba-a720-292d440edd5e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:46.402444 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d0caae93-9f78-48ba-a720-292d440edd5e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:46.409207 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d0caae93-9f78-48ba-a720-292d440edd5e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:46.409696 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d0caae93-9f78-48ba-a720-292d440edd5e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:46.411887 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d0caae93-9f78-48ba-a720-292d440edd5e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:46.411887 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d0caae93-9f78-48ba-a720-292d440edd5e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:46.411887 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d0caae93-9f78-48ba-a720-292d440edd5e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:46.411887 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d0caae93-9f78-48ba-a720-292d440edd5e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:46.547133 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d0caae93-9f78-48ba-a720-292d440edd5e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:46.555004 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d0caae93-9f78-48ba-a720-292d440edd5e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1368 microversion: 2.1 time: 0.157888 Sep 03 01:39:46.556136 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 488/1007] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:46 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:46.585884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-fb5e09c7-00df-40ed-845b-44aacc39d3d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:46.586595 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-fb5e09c7-00df-40ed-845b-44aacc39d3d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:46.588610 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:46.589730 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=8 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:46.594360 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fb5e09c7-00df-40ed-845b-44aacc39d3d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:46.594848 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fb5e09c7-00df-40ed-845b-44aacc39d3d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:46.595278 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fb5e09c7-00df-40ed-845b-44aacc39d3d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:46.595952 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fb5e09c7-00df-40ed-845b-44aacc39d3d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:46.596397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fb5e09c7-00df-40ed-845b-44aacc39d3d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:46.596813 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fb5e09c7-00df-40ed-845b-44aacc39d3d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:46.729856 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-fb5e09c7-00df-40ed-845b-44aacc39d3d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:46.737873 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-fb5e09c7-00df-40ed-845b-44aacc39d3d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:46.739330 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-fb5e09c7-00df-40ed-845b-44aacc39d3d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:46.740484 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-fb5e09c7-00df-40ed-845b-44aacc39d3d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.158504 Sep 03 01:39:46.741045 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 520/1008] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:39:46 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:39:47.300748 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1b5baaf3-36dc-46eb-8797-d88e9e00b519 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "257ff041-f59d-49f6-9774-696749811cfa"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:39:47.303216 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1b5baaf3-36dc-46eb-8797-d88e9e00b519 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:47.309459 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1b5baaf3-36dc-46eb-8797-d88e9e00b519 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:47.309944 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1b5baaf3-36dc-46eb-8797-d88e9e00b519 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:47.310400 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1b5baaf3-36dc-46eb-8797-d88e9e00b519 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:47.311087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1b5baaf3-36dc-46eb-8797-d88e9e00b519 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:47.311537 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1b5baaf3-36dc-46eb-8797-d88e9e00b519 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:47.311968 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1b5baaf3-36dc-46eb-8797-d88e9e00b519 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:47.578271 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-95d7e8e1-2658-45d4-992b-63a6f8713571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:47.578980 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-95d7e8e1-2658-45d4-992b-63a6f8713571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:47.584930 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95d7e8e1-2658-45d4-992b-63a6f8713571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:47.585410 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95d7e8e1-2658-45d4-992b-63a6f8713571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:47.585846 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95d7e8e1-2658-45d4-992b-63a6f8713571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:47.586556 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95d7e8e1-2658-45d4-992b-63a6f8713571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:47.587902 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95d7e8e1-2658-45d4-992b-63a6f8713571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:47.588470 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-95d7e8e1-2658-45d4-992b-63a6f8713571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:47.743424 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-95d7e8e1-2658-45d4-992b-63a6f8713571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:47.750978 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-95d7e8e1-2658-45d4-992b-63a6f8713571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1368 microversion: 2.1 time: 0.176590 Sep 03 01:39:47.751538 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 521/1009] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:47 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:39:47.772156 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-382c32e4-4328-4795-be2e-18e84a975000 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:47.772768 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-382c32e4-4328-4795-be2e-18e84a975000 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:47.779797 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-382c32e4-4328-4795-be2e-18e84a975000 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:47.780349 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-382c32e4-4328-4795-be2e-18e84a975000 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:47.780786 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-382c32e4-4328-4795-be2e-18e84a975000 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:47.781491 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-382c32e4-4328-4795-be2e-18e84a975000 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:47.781948 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-382c32e4-4328-4795-be2e-18e84a975000 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:47.782395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-382c32e4-4328-4795-be2e-18e84a975000 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:47.919181 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-382c32e4-4328-4795-be2e-18e84a975000 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:47.927353 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-382c32e4-4328-4795-be2e-18e84a975000 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:47.928790 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-382c32e4-4328-4795-be2e-18e84a975000 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:47.929981 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-382c32e4-4328-4795-be2e-18e84a975000 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.162556 Sep 03 01:39:47.931346 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 522/1010] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:39:47 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:39:48.148169 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1b5baaf3-36dc-46eb-8797-d88e9e00b519 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "POST /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.851153 Sep 03 01:39:48.148760 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 489/1011] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:39:47 2022] POST /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments => generated 194 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:48.777586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-27c822fa-9b4b-4586-91d9-61d2c110ac7f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:48.778191 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-27c822fa-9b4b-4586-91d9-61d2c110ac7f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:48.784843 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-27c822fa-9b4b-4586-91d9-61d2c110ac7f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:48.785318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-27c822fa-9b4b-4586-91d9-61d2c110ac7f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:48.785748 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-27c822fa-9b4b-4586-91d9-61d2c110ac7f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:48.786448 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-27c822fa-9b4b-4586-91d9-61d2c110ac7f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:48.786895 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-27c822fa-9b4b-4586-91d9-61d2c110ac7f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:48.787315 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-27c822fa-9b4b-4586-91d9-61d2c110ac7f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:48.919154 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-27c822fa-9b4b-4586-91d9-61d2c110ac7f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:48.926710 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-27c822fa-9b4b-4586-91d9-61d2c110ac7f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1368 microversion: 2.1 time: 0.153586 Sep 03 01:39:48.927270 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 523/1012] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:48 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:48.956172 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d871a56b-0ef0-4d40-928b-438a5c92d0d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:48.956853 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d871a56b-0ef0-4d40-928b-438a5c92d0d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:48.963113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d871a56b-0ef0-4d40-928b-438a5c92d0d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:48.963590 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d871a56b-0ef0-4d40-928b-438a5c92d0d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:48.964017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d871a56b-0ef0-4d40-928b-438a5c92d0d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:48.964705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d871a56b-0ef0-4d40-928b-438a5c92d0d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:48.965152 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d871a56b-0ef0-4d40-928b-438a5c92d0d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:48.965573 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d871a56b-0ef0-4d40-928b-438a5c92d0d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:49.096281 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d871a56b-0ef0-4d40-928b-438a5c92d0d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:49.104217 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d871a56b-0ef0-4d40-928b-438a5c92d0d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:49.105626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d871a56b-0ef0-4d40-928b-438a5c92d0d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:49.106801 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d871a56b-0ef0-4d40-928b-438a5c92d0d5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.155339 Sep 03 01:39:49.107354 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 490/1013] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:39:48 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:39:49.955905 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0b0909ce-b347-4914-b416-2921b17189a7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:49.955905 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0b0909ce-b347-4914-b416-2921b17189a7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:49.957587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0b0909ce-b347-4914-b416-2921b17189a7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:49.958061 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0b0909ce-b347-4914-b416-2921b17189a7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:49.958521 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0b0909ce-b347-4914-b416-2921b17189a7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:49.959199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0b0909ce-b347-4914-b416-2921b17189a7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:49.959695 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0b0909ce-b347-4914-b416-2921b17189a7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:49.960111 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0b0909ce-b347-4914-b416-2921b17189a7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:50.090663 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0b0909ce-b347-4914-b416-2921b17189a7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:50.098297 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0b0909ce-b347-4914-b416-2921b17189a7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1368 microversion: 2.1 time: 0.152006 Sep 03 01:39:50.098893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 524/1014] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:49 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:50.132628 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-65fee2a4-8add-4c5a-9f77-3a43d1140abb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:50.133232 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-65fee2a4-8add-4c5a-9f77-3a43d1140abb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:50.140288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65fee2a4-8add-4c5a-9f77-3a43d1140abb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:50.140769 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65fee2a4-8add-4c5a-9f77-3a43d1140abb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:50.141201 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65fee2a4-8add-4c5a-9f77-3a43d1140abb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:50.141880 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65fee2a4-8add-4c5a-9f77-3a43d1140abb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:50.142422 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65fee2a4-8add-4c5a-9f77-3a43d1140abb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:50.142848 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-65fee2a4-8add-4c5a-9f77-3a43d1140abb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:50.268442 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-65fee2a4-8add-4c5a-9f77-3a43d1140abb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:50.277025 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-65fee2a4-8add-4c5a-9f77-3a43d1140abb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:50.278481 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-65fee2a4-8add-4c5a-9f77-3a43d1140abb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:50.279635 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-65fee2a4-8add-4c5a-9f77-3a43d1140abb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.151000 Sep 03 01:39:50.280186 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 491/1015] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:39:50 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:39:51.121288 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-54c8a15b-6a3f-4792-803e-04dd6f786e2f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:51.121831 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-54c8a15b-6a3f-4792-803e-04dd6f786e2f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:51.123902 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:51.128578 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54c8a15b-6a3f-4792-803e-04dd6f786e2f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:51.129018 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54c8a15b-6a3f-4792-803e-04dd6f786e2f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:51.129446 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54c8a15b-6a3f-4792-803e-04dd6f786e2f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:51.130122 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54c8a15b-6a3f-4792-803e-04dd6f786e2f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:51.130598 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54c8a15b-6a3f-4792-803e-04dd6f786e2f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:51.131019 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-54c8a15b-6a3f-4792-803e-04dd6f786e2f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:51.257742 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-54c8a15b-6a3f-4792-803e-04dd6f786e2f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:51.265252 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-54c8a15b-6a3f-4792-803e-04dd6f786e2f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1368 microversion: 2.1 time: 0.148118 Sep 03 01:39:51.265818 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 525/1016] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:51 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1368 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:51.305197 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5bbf8e3d-a0c7-4c4f-9cc7-784bfc35e2a4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:51.305797 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5bbf8e3d-a0c7-4c4f-9cc7-784bfc35e2a4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:51.308341 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:51.313204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5bbf8e3d-a0c7-4c4f-9cc7-784bfc35e2a4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:51.313695 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5bbf8e3d-a0c7-4c4f-9cc7-784bfc35e2a4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:51.314232 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5bbf8e3d-a0c7-4c4f-9cc7-784bfc35e2a4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:51.314971 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5bbf8e3d-a0c7-4c4f-9cc7-784bfc35e2a4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:51.315433 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5bbf8e3d-a0c7-4c4f-9cc7-784bfc35e2a4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:51.315870 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5bbf8e3d-a0c7-4c4f-9cc7-784bfc35e2a4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:51.457388 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5bbf8e3d-a0c7-4c4f-9cc7-784bfc35e2a4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:51.466438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5bbf8e3d-a0c7-4c4f-9cc7-784bfc35e2a4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:51.468000 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5bbf8e3d-a0c7-4c4f-9cc7-784bfc35e2a4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:51.469045 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5bbf8e3d-a0c7-4c4f-9cc7-784bfc35e2a4 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.167959 Sep 03 01:39:51.474474 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 492/1017] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:39:51 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:39:52.288874 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b71adcd5-3006-4573-aa77-256f09e72716 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:52.289484 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b71adcd5-3006-4573-aa77-256f09e72716 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:52.296919 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b71adcd5-3006-4573-aa77-256f09e72716 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:52.297407 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b71adcd5-3006-4573-aa77-256f09e72716 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:52.297838 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b71adcd5-3006-4573-aa77-256f09e72716 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:52.298560 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b71adcd5-3006-4573-aa77-256f09e72716 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:52.299010 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b71adcd5-3006-4573-aa77-256f09e72716 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:52.299432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b71adcd5-3006-4573-aa77-256f09e72716 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:52.445737 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b71adcd5-3006-4573-aa77-256f09e72716 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:52.451312 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b71adcd5-3006-4573-aa77-256f09e72716 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1368 microversion: 2.1 time: 0.166263 Sep 03 01:39:52.451890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 526/1018] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:52 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:52.500387 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e2ff1316-5071-41c2-becc-68f22339617e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:52.502152 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e2ff1316-5071-41c2-becc-68f22339617e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:52.507573 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e2ff1316-5071-41c2-becc-68f22339617e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:52.508060 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e2ff1316-5071-41c2-becc-68f22339617e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:52.508504 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e2ff1316-5071-41c2-becc-68f22339617e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:52.509192 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e2ff1316-5071-41c2-becc-68f22339617e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:52.509645 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e2ff1316-5071-41c2-becc-68f22339617e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:52.510073 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e2ff1316-5071-41c2-becc-68f22339617e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:52.643349 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e2ff1316-5071-41c2-becc-68f22339617e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:52.652296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e2ff1316-5071-41c2-becc-68f22339617e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:52.653789 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e2ff1316-5071-41c2-becc-68f22339617e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:52.655176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e2ff1316-5071-41c2-becc-68f22339617e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.158880 Sep 03 01:39:52.655822 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 493/1019] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:39:52 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:39:53.476163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9d933352-f2eb-4791-93b2-88bc97102bce tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:53.476530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9d933352-f2eb-4791-93b2-88bc97102bce tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:53.483680 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9d933352-f2eb-4791-93b2-88bc97102bce tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:53.484163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9d933352-f2eb-4791-93b2-88bc97102bce tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:53.485868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9d933352-f2eb-4791-93b2-88bc97102bce tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:53.485868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9d933352-f2eb-4791-93b2-88bc97102bce tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:53.485868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9d933352-f2eb-4791-93b2-88bc97102bce tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:53.486271 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9d933352-f2eb-4791-93b2-88bc97102bce tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:53.566623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-5bca9d0a-de61-41d6-8b82-b541608bbece req-096c2478-a7c7-4f21-93d8-8b9ba96251e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339527e0-bd33-4cfb-950f-ccb7a68a69bc", "name": "network-vif-plugged", "status": "completed", "tag": "914b4f37-4e68-434b-abc8-978883c344a6"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:39:53.577077 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-5bca9d0a-de61-41d6-8b82-b541608bbece req-096c2478-a7c7-4f21-93d8-8b9ba96251e5 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:53.578239 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-5bca9d0a-de61-41d6-8b82-b541608bbece req-096c2478-a7c7-4f21-93d8-8b9ba96251e5 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:53.579050 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-5bca9d0a-de61-41d6-8b82-b541608bbece req-096c2478-a7c7-4f21-93d8-8b9ba96251e5 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:53.595362 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-5bca9d0a-de61-41d6-8b82-b541608bbece req-096c2478-a7c7-4f21-93d8-8b9ba96251e5 service nova] Creating event network-vif-plugged:914b4f37-4e68-434b-abc8-978883c344a6 for instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc on hv-cinder-83800 Sep 03 01:39:53.600709 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-5bca9d0a-de61-41d6-8b82-b541608bbece req-096c2478-a7c7-4f21-93d8-8b9ba96251e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037938 Sep 03 01:39:53.601853 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 494/1020] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:39:53.655089 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9d933352-f2eb-4791-93b2-88bc97102bce tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:53.664247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9d933352-f2eb-4791-93b2-88bc97102bce tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1368 microversion: 2.1 time: 0.193812 Sep 03 01:39:53.681983 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-25380237-167e-4914-93b7-a83ce475a3f7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:53.682150 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 527/1021] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:53 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:39:53.683285 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-25380237-167e-4914-93b7-a83ce475a3f7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:53.692434 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25380237-167e-4914-93b7-a83ce475a3f7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:53.693056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25380237-167e-4914-93b7-a83ce475a3f7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:53.693638 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25380237-167e-4914-93b7-a83ce475a3f7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:53.694476 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25380237-167e-4914-93b7-a83ce475a3f7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:53.695106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25380237-167e-4914-93b7-a83ce475a3f7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:53.695620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-25380237-167e-4914-93b7-a83ce475a3f7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:53.832654 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-25380237-167e-4914-93b7-a83ce475a3f7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:53.841325 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-25380237-167e-4914-93b7-a83ce475a3f7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:53.843167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-25380237-167e-4914-93b7-a83ce475a3f7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:53.844416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-25380237-167e-4914-93b7-a83ce475a3f7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.167293 Sep 03 01:39:53.844946 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 495/1022] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:39:53 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:39:54.688984 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ca4b11a9-3426-46ad-b74a-3a5fb2693043 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:54.689590 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ca4b11a9-3426-46ad-b74a-3a5fb2693043 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:54.696218 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ca4b11a9-3426-46ad-b74a-3a5fb2693043 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:54.696855 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ca4b11a9-3426-46ad-b74a-3a5fb2693043 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:54.697292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ca4b11a9-3426-46ad-b74a-3a5fb2693043 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:54.697985 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ca4b11a9-3426-46ad-b74a-3a5fb2693043 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:54.698463 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ca4b11a9-3426-46ad-b74a-3a5fb2693043 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:54.698884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ca4b11a9-3426-46ad-b74a-3a5fb2693043 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:54.834439 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ca4b11a9-3426-46ad-b74a-3a5fb2693043 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:54.842647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ca4b11a9-3426-46ad-b74a-3a5fb2693043 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1368 microversion: 2.1 time: 0.157451 Sep 03 01:39:54.843220 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 528/1023] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:54 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:54.870293 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0b133cd5-d7f1-4cdc-adb8-e184c2322dd5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:54.870923 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-0b133cd5-d7f1-4cdc-adb8-e184c2322dd5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:54.877849 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b133cd5-d7f1-4cdc-adb8-e184c2322dd5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:54.878325 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b133cd5-d7f1-4cdc-adb8-e184c2322dd5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:54.878782 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b133cd5-d7f1-4cdc-adb8-e184c2322dd5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:54.879461 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b133cd5-d7f1-4cdc-adb8-e184c2322dd5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:54.879906 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b133cd5-d7f1-4cdc-adb8-e184c2322dd5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:54.880324 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0b133cd5-d7f1-4cdc-adb8-e184c2322dd5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:55.009671 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-0b133cd5-d7f1-4cdc-adb8-e184c2322dd5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:55.016289 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-0b133cd5-d7f1-4cdc-adb8-e184c2322dd5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:55.017736 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-0b133cd5-d7f1-4cdc-adb8-e184c2322dd5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:55.018934 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0b133cd5-d7f1-4cdc-adb8-e184c2322dd5 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.152673 Sep 03 01:39:55.019493 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 496/1024] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:39:54 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:39:55.866179 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-62c72c73-42dd-487f-8ceb-c19feb1e5606 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:55.866744 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-62c72c73-42dd-487f-8ceb-c19feb1e5606 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:55.873913 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62c72c73-42dd-487f-8ceb-c19feb1e5606 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:55.874430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62c72c73-42dd-487f-8ceb-c19feb1e5606 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:55.874872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62c72c73-42dd-487f-8ceb-c19feb1e5606 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:55.875567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62c72c73-42dd-487f-8ceb-c19feb1e5606 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:55.876022 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62c72c73-42dd-487f-8ceb-c19feb1e5606 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:55.876447 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62c72c73-42dd-487f-8ceb-c19feb1e5606 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:56.006216 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-62c72c73-42dd-487f-8ceb-c19feb1e5606 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:56.014007 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-62c72c73-42dd-487f-8ceb-c19feb1e5606 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1557 microversion: 2.1 time: 0.151786 Sep 03 01:39:56.014618 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 529/1025] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:39:55 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:39:56.037053 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-01570e02-9993-4930-b485-f72cc22472e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:56.037634 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-01570e02-9993-4930-b485-f72cc22472e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:56.045484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-01570e02-9993-4930-b485-f72cc22472e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:56.045647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5a7f2643-a24c-4ea5-8177-ddb356cfbd42 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:56.046056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-01570e02-9993-4930-b485-f72cc22472e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:56.050905 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5a7f2643-a24c-4ea5-8177-ddb356cfbd42 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:56.051089 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-01570e02-9993-4930-b485-f72cc22472e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:56.051089 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-01570e02-9993-4930-b485-f72cc22472e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:56.051089 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-01570e02-9993-4930-b485-f72cc22472e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:56.051089 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-01570e02-9993-4930-b485-f72cc22472e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:56.052420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5a7f2643-a24c-4ea5-8177-ddb356cfbd42 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:56.052910 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5a7f2643-a24c-4ea5-8177-ddb356cfbd42 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:56.053352 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5a7f2643-a24c-4ea5-8177-ddb356cfbd42 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:56.054181 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5a7f2643-a24c-4ea5-8177-ddb356cfbd42 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:56.054680 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5a7f2643-a24c-4ea5-8177-ddb356cfbd42 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:56.055091 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5a7f2643-a24c-4ea5-8177-ddb356cfbd42 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:56.129159 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-01570e02-9993-4930-b485-f72cc22472e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096449 Sep 03 01:39:56.129899 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 497/1026] 10.222.0.13 () {58 vars in 1275 bytes} [Sat Sep 3 01:39:56 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:56.295492 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5a7f2643-a24c-4ea5-8177-ddb356cfbd42 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:56.303962 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5a7f2643-a24c-4ea5-8177-ddb356cfbd42 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:56.305440 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5a7f2643-a24c-4ea5-8177-ddb356cfbd42 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:56.306655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5a7f2643-a24c-4ea5-8177-ddb356cfbd42 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.264924 Sep 03 01:39:56.307214 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 530/1027] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:39:56 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:39:57.174721 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-4608c403-78b3-46e3-9906-763f5c10d99b req-4ba490cd-307e-45ab-88ce-443ca7084e7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "339527e0-bd33-4cfb-950f-ccb7a68a69bc", "tag": "914b4f37-4e68-434b-abc8-978883c344a6"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:39:57.185682 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-4608c403-78b3-46e3-9906-763f5c10d99b req-4ba490cd-307e-45ab-88ce-443ca7084e7f service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:57.186161 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-4608c403-78b3-46e3-9906-763f5c10d99b req-4ba490cd-307e-45ab-88ce-443ca7084e7f service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:57.186624 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-4608c403-78b3-46e3-9906-763f5c10d99b req-4ba490cd-307e-45ab-88ce-443ca7084e7f service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:57.199448 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-4608c403-78b3-46e3-9906-763f5c10d99b req-4ba490cd-307e-45ab-88ce-443ca7084e7f service nova] Creating event network-changed:914b4f37-4e68-434b-abc8-978883c344a6 for instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc on hv-cinder-83800 Sep 03 01:39:57.208837 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-4608c403-78b3-46e3-9906-763f5c10d99b req-4ba490cd-307e-45ab-88ce-443ca7084e7f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038360 Sep 03 01:39:57.210252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 498/1028] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:39:57.332035 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0913d3ea-e82c-4b12-961e-8647451f6308 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:57.332640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0913d3ea-e82c-4b12-961e-8647451f6308 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:57.340489 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0913d3ea-e82c-4b12-961e-8647451f6308 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:57.341222 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0913d3ea-e82c-4b12-961e-8647451f6308 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:57.341802 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0913d3ea-e82c-4b12-961e-8647451f6308 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:57.342712 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0913d3ea-e82c-4b12-961e-8647451f6308 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:57.343317 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0913d3ea-e82c-4b12-961e-8647451f6308 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:57.343934 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0913d3ea-e82c-4b12-961e-8647451f6308 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:57.369976 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:39:57.536286 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0913d3ea-e82c-4b12-961e-8647451f6308 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:57.536286 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0913d3ea-e82c-4b12-961e-8647451f6308 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:57.536878 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0913d3ea-e82c-4b12-961e-8647451f6308 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:57.536878 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0913d3ea-e82c-4b12-961e-8647451f6308 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.207775 Sep 03 01:39:57.536878 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 531/1029] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:39:57 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:39:58.565338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c7ac391d-a9d5-49fe-8d42-dbbcfc3d8e2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:58.566109 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c7ac391d-a9d5-49fe-8d42-dbbcfc3d8e2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:58.574367 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c7ac391d-a9d5-49fe-8d42-dbbcfc3d8e2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:58.575513 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c7ac391d-a9d5-49fe-8d42-dbbcfc3d8e2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:58.575643 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c7ac391d-a9d5-49fe-8d42-dbbcfc3d8e2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:58.576369 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c7ac391d-a9d5-49fe-8d42-dbbcfc3d8e2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:58.576828 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c7ac391d-a9d5-49fe-8d42-dbbcfc3d8e2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:58.577259 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c7ac391d-a9d5-49fe-8d42-dbbcfc3d8e2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:58.719284 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c7ac391d-a9d5-49fe-8d42-dbbcfc3d8e2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:58.727973 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c7ac391d-a9d5-49fe-8d42-dbbcfc3d8e2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:58.729422 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c7ac391d-a9d5-49fe-8d42-dbbcfc3d8e2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:58.730614 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c7ac391d-a9d5-49fe-8d42-dbbcfc3d8e2c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.172517 Sep 03 01:39:58.731196 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 499/1030] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:39:58 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:39:58.924478 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-062e6003-316e-461d-8933-d6cb4024369a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:58.926895 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-062e6003-316e-461d-8933-d6cb4024369a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:58.934667 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-062e6003-316e-461d-8933-d6cb4024369a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:58.935233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-062e6003-316e-461d-8933-d6cb4024369a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:58.935739 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-062e6003-316e-461d-8933-d6cb4024369a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:58.936523 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-062e6003-316e-461d-8933-d6cb4024369a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:58.937096 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-062e6003-316e-461d-8933-d6cb4024369a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:58.937581 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-062e6003-316e-461d-8933-d6cb4024369a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:58.968267 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-062e6003-316e-461d-8933-d6cb4024369a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048118 Sep 03 01:39:58.968746 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 532/1031] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:39:58 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:58.979626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-77739899-6b96-4964-97ac-adf33034c0c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:58.980118 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-77739899-6b96-4964-97ac-adf33034c0c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:58.986136 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77739899-6b96-4964-97ac-adf33034c0c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:58.986659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77739899-6b96-4964-97ac-adf33034c0c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:58.987102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77739899-6b96-4964-97ac-adf33034c0c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:58.987788 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77739899-6b96-4964-97ac-adf33034c0c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:58.988284 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77739899-6b96-4964-97ac-adf33034c0c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:58.988710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-77739899-6b96-4964-97ac-adf33034c0c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:59.018459 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-77739899-6b96-4964-97ac-adf33034c0c9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments/257ff041-f59d-49f6-9774-696749811cfa" status: 200 len: 194 microversion: 2.1 time: 0.042775 Sep 03 01:39:59.019054 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 500/1032] 10.222.0.13 () {58 vars in 1413 bytes} [Sat Sep 3 01:39:58 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments/257ff041-f59d-49f6-9774-696749811cfa => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:39:59.757311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5a575a89-9961-48b6-9f04-c2af4c451140 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:39:59.757998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5a575a89-9961-48b6-9f04-c2af4c451140 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:39:59.764709 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5a575a89-9961-48b6-9f04-c2af4c451140 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:59.765338 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5a575a89-9961-48b6-9f04-c2af4c451140 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:59.765826 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5a575a89-9961-48b6-9f04-c2af4c451140 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:59.766703 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5a575a89-9961-48b6-9f04-c2af4c451140 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:39:59.767225 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5a575a89-9961-48b6-9f04-c2af4c451140 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:39:59.767647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5a575a89-9961-48b6-9f04-c2af4c451140 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:39:59.904718 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5a575a89-9961-48b6-9f04-c2af4c451140 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:59.913222 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5a575a89-9961-48b6-9f04-c2af4c451140 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:59.915259 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5a575a89-9961-48b6-9f04-c2af4c451140 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:39:59.916751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5a575a89-9961-48b6-9f04-c2af4c451140 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.164576 Sep 03 01:39:59.917323 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 533/1033] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:39:59 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:00.685245 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0c7fb9c7-81bc-40b1-84f4-4e24018096f9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc5aba88-0fcb-4ec0-bffc-be82786a9fb3"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:40:00.688333 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-0c7fb9c7-81bc-40b1-84f4-4e24018096f9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:00.694887 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0c7fb9c7-81bc-40b1-84f4-4e24018096f9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:00.695382 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0c7fb9c7-81bc-40b1-84f4-4e24018096f9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:00.696528 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0c7fb9c7-81bc-40b1-84f4-4e24018096f9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:00.697341 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0c7fb9c7-81bc-40b1-84f4-4e24018096f9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:00.697796 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0c7fb9c7-81bc-40b1-84f4-4e24018096f9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:00.698219 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0c7fb9c7-81bc-40b1-84f4-4e24018096f9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:00.940131 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:00.943625 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-03aa9cc2-5ca5-4629-80fa-21dec11e1df7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:00.944546 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-03aa9cc2-5ca5-4629-80fa-21dec11e1df7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:00.952530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-03aa9cc2-5ca5-4629-80fa-21dec11e1df7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:00.953094 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-03aa9cc2-5ca5-4629-80fa-21dec11e1df7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:00.953603 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-03aa9cc2-5ca5-4629-80fa-21dec11e1df7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:00.954306 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-03aa9cc2-5ca5-4629-80fa-21dec11e1df7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:00.954792 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-03aa9cc2-5ca5-4629-80fa-21dec11e1df7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:00.955217 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-03aa9cc2-5ca5-4629-80fa-21dec11e1df7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:01.095411 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-03aa9cc2-5ca5-4629-80fa-21dec11e1df7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:01.103636 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-03aa9cc2-5ca5-4629-80fa-21dec11e1df7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:01.105076 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-03aa9cc2-5ca5-4629-80fa-21dec11e1df7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:01.106232 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-03aa9cc2-5ca5-4629-80fa-21dec11e1df7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.167053 Sep 03 01:40:01.106835 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 534/1034] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:00 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:40:01.583241 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0c7fb9c7-81bc-40b1-84f4-4e24018096f9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "POST /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.902217 Sep 03 01:40:01.583852 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 501/1035] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:40:00 2022] POST /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments => generated 194 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:40:02.132866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-19571cd0-5156-4990-8e7f-cc3a1a1616fd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:02.133957 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-19571cd0-5156-4990-8e7f-cc3a1a1616fd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:02.142500 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-19571cd0-5156-4990-8e7f-cc3a1a1616fd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:02.142990 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-19571cd0-5156-4990-8e7f-cc3a1a1616fd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:02.143454 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-19571cd0-5156-4990-8e7f-cc3a1a1616fd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:02.145655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-19571cd0-5156-4990-8e7f-cc3a1a1616fd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:02.146115 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-19571cd0-5156-4990-8e7f-cc3a1a1616fd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:02.146570 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-19571cd0-5156-4990-8e7f-cc3a1a1616fd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:02.276454 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-19571cd0-5156-4990-8e7f-cc3a1a1616fd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:02.284721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-19571cd0-5156-4990-8e7f-cc3a1a1616fd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:02.286149 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-19571cd0-5156-4990-8e7f-cc3a1a1616fd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:02.287332 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-19571cd0-5156-4990-8e7f-cc3a1a1616fd tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.158881 Sep 03 01:40:02.287896 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 535/1036] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:02 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:03.316213 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-833810a9-539c-4aad-b8f4-436f74ed8154 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:03.316899 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-833810a9-539c-4aad-b8f4-436f74ed8154 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:03.323804 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-833810a9-539c-4aad-b8f4-436f74ed8154 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:03.324288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-833810a9-539c-4aad-b8f4-436f74ed8154 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:03.324755 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-833810a9-539c-4aad-b8f4-436f74ed8154 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:03.325545 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-833810a9-539c-4aad-b8f4-436f74ed8154 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:03.325986 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-833810a9-539c-4aad-b8f4-436f74ed8154 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:03.326435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-833810a9-539c-4aad-b8f4-436f74ed8154 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:03.553462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-833810a9-539c-4aad-b8f4-436f74ed8154 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:03.567235 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-833810a9-539c-4aad-b8f4-436f74ed8154 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:03.568750 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-833810a9-539c-4aad-b8f4-436f74ed8154 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:03.569946 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-833810a9-539c-4aad-b8f4-436f74ed8154 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.259281 Sep 03 01:40:03.588140 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 502/1037] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:03 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:04.599364 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c2aaa697-ec1e-4ef4-b8d4-46a7770f5e5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:04.600008 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c2aaa697-ec1e-4ef4-b8d4-46a7770f5e5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:04.611484 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c2aaa697-ec1e-4ef4-b8d4-46a7770f5e5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:04.612178 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c2aaa697-ec1e-4ef4-b8d4-46a7770f5e5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:04.612616 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c2aaa697-ec1e-4ef4-b8d4-46a7770f5e5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:04.613311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c2aaa697-ec1e-4ef4-b8d4-46a7770f5e5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:04.613762 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c2aaa697-ec1e-4ef4-b8d4-46a7770f5e5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:04.614183 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c2aaa697-ec1e-4ef4-b8d4-46a7770f5e5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:04.783205 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c2aaa697-ec1e-4ef4-b8d4-46a7770f5e5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:04.792492 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c2aaa697-ec1e-4ef4-b8d4-46a7770f5e5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:04.794225 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c2aaa697-ec1e-4ef4-b8d4-46a7770f5e5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:04.803231 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c2aaa697-ec1e-4ef4-b8d4-46a7770f5e5c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.199798 Sep 03 01:40:04.803231 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 536/1038] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:04 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:05.821136 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e9270408-3ee0-4b41-a35b-ebfecd399fca tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:05.821746 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e9270408-3ee0-4b41-a35b-ebfecd399fca tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:05.828549 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e9270408-3ee0-4b41-a35b-ebfecd399fca tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:05.829031 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e9270408-3ee0-4b41-a35b-ebfecd399fca tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:05.829467 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e9270408-3ee0-4b41-a35b-ebfecd399fca tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:05.830161 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e9270408-3ee0-4b41-a35b-ebfecd399fca tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:05.830646 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e9270408-3ee0-4b41-a35b-ebfecd399fca tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:05.831079 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e9270408-3ee0-4b41-a35b-ebfecd399fca tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:06.200347 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e9270408-3ee0-4b41-a35b-ebfecd399fca tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:06.208615 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e9270408-3ee0-4b41-a35b-ebfecd399fca tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:06.210083 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e9270408-3ee0-4b41-a35b-ebfecd399fca tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:06.211480 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e9270408-3ee0-4b41-a35b-ebfecd399fca tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.394711 Sep 03 01:40:06.212039 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 503/1039] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:05 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:07.236998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b92f1f47-935a-4f6a-ac90-44a0760b434d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:07.237558 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b92f1f47-935a-4f6a-ac90-44a0760b434d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:07.243993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b92f1f47-935a-4f6a-ac90-44a0760b434d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:07.244475 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b92f1f47-935a-4f6a-ac90-44a0760b434d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:07.244906 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b92f1f47-935a-4f6a-ac90-44a0760b434d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:07.245584 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b92f1f47-935a-4f6a-ac90-44a0760b434d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:07.246029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b92f1f47-935a-4f6a-ac90-44a0760b434d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:07.246489 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b92f1f47-935a-4f6a-ac90-44a0760b434d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:07.373440 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b92f1f47-935a-4f6a-ac90-44a0760b434d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:07.381379 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b92f1f47-935a-4f6a-ac90-44a0760b434d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:07.383329 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b92f1f47-935a-4f6a-ac90-44a0760b434d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:07.384570 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b92f1f47-935a-4f6a-ac90-44a0760b434d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1744 microversion: 2.20 time: 0.151576 Sep 03 01:40:07.385126 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 537/1040] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:07 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1744 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:08.410791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d06ec304-6368-4779-a4a0-dbc972eccafb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:08.411391 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d06ec304-6368-4779-a4a0-dbc972eccafb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:08.418537 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d06ec304-6368-4779-a4a0-dbc972eccafb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:08.419041 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d06ec304-6368-4779-a4a0-dbc972eccafb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:08.419474 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d06ec304-6368-4779-a4a0-dbc972eccafb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:08.420154 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d06ec304-6368-4779-a4a0-dbc972eccafb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:08.420600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d06ec304-6368-4779-a4a0-dbc972eccafb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:08.421015 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d06ec304-6368-4779-a4a0-dbc972eccafb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:08.545109 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d06ec304-6368-4779-a4a0-dbc972eccafb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:08.553030 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d06ec304-6368-4779-a4a0-dbc972eccafb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:08.554517 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d06ec304-6368-4779-a4a0-dbc972eccafb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:08.555711 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d06ec304-6368-4779-a4a0-dbc972eccafb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1744 microversion: 2.20 time: 0.149248 Sep 03 01:40:08.556243 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 504/1041] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:08 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1744 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:09.579798 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ebd6f5f0-5add-4b1b-81a6-04a2fb72f3bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:09.580488 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ebd6f5f0-5add-4b1b-81a6-04a2fb72f3bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:09.587420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ebd6f5f0-5add-4b1b-81a6-04a2fb72f3bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:09.588034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ebd6f5f0-5add-4b1b-81a6-04a2fb72f3bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:09.588461 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ebd6f5f0-5add-4b1b-81a6-04a2fb72f3bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:09.589182 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ebd6f5f0-5add-4b1b-81a6-04a2fb72f3bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:09.589625 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ebd6f5f0-5add-4b1b-81a6-04a2fb72f3bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:09.590043 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ebd6f5f0-5add-4b1b-81a6-04a2fb72f3bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:09.620330 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-620b3454-94ee-4565-811e-c2b2e549dbdf req-b2468c76-9765-47c1-ab41-eaaa232e33d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e156f97d-5465-4597-a836-c70692edfd41", "name": "network-vif-plugged", "status": "completed", "tag": "b4585caf-c260-4618-ba71-326b4c35ffdf"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:40:09.638470 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-620b3454-94ee-4565-811e-c2b2e549dbdf req-b2468c76-9765-47c1-ab41-eaaa232e33d8 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:09.639646 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-620b3454-94ee-4565-811e-c2b2e549dbdf req-b2468c76-9765-47c1-ab41-eaaa232e33d8 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:09.639646 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-620b3454-94ee-4565-811e-c2b2e549dbdf req-b2468c76-9765-47c1-ab41-eaaa232e33d8 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:09.653290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-620b3454-94ee-4565-811e-c2b2e549dbdf req-b2468c76-9765-47c1-ab41-eaaa232e33d8 service nova] Creating event network-vif-plugged:b4585caf-c260-4618-ba71-326b4c35ffdf for instance e156f97d-5465-4597-a836-c70692edfd41 on hv-cinder-83800 Sep 03 01:40:09.658679 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-620b3454-94ee-4565-811e-c2b2e549dbdf req-b2468c76-9765-47c1-ab41-eaaa232e33d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042749 Sep 03 01:40:09.662295 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 505/1042] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:40:09.744176 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ebd6f5f0-5add-4b1b-81a6-04a2fb72f3bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:09.753657 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ebd6f5f0-5add-4b1b-81a6-04a2fb72f3bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:09.757375 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ebd6f5f0-5add-4b1b-81a6-04a2fb72f3bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:09.757375 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ebd6f5f0-5add-4b1b-81a6-04a2fb72f3bb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1739 microversion: 2.20 time: 0.180708 Sep 03 01:40:09.757375 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 538/1043] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:09 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:10.249888 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-fca06360-cb20-4e99-b06d-cb87169eef77 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:10.252407 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-fca06360-cb20-4e99-b06d-cb87169eef77 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:10.259914 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fca06360-cb20-4e99-b06d-cb87169eef77 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:10.260700 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fca06360-cb20-4e99-b06d-cb87169eef77 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:10.261138 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fca06360-cb20-4e99-b06d-cb87169eef77 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:10.261846 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fca06360-cb20-4e99-b06d-cb87169eef77 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:10.262306 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fca06360-cb20-4e99-b06d-cb87169eef77 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:10.262768 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fca06360-cb20-4e99-b06d-cb87169eef77 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:10.296897 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-fca06360-cb20-4e99-b06d-cb87169eef77 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.051514 Sep 03 01:40:10.297642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 506/1044] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:40:10 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments => generated 371 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:40:10.449415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-de59dbc9-ffc6-4411-83e1-83da42f384ff tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:10.450288 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-de59dbc9-ffc6-4411-83e1-83da42f384ff tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:10.460717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-de59dbc9-ffc6-4411-83e1-83da42f384ff tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:10.461348 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-de59dbc9-ffc6-4411-83e1-83da42f384ff tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:10.461848 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-de59dbc9-ffc6-4411-83e1-83da42f384ff tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:10.462651 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-de59dbc9-ffc6-4411-83e1-83da42f384ff tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:10.463170 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-de59dbc9-ffc6-4411-83e1-83da42f384ff tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:10.463661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-de59dbc9-ffc6-4411-83e1-83da42f384ff tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:10.506202 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-de59dbc9-ffc6-4411-83e1-83da42f384ff tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments/257ff041-f59d-49f6-9774-696749811cfa" status: 200 len: 194 microversion: 2.1 time: 0.059713 Sep 03 01:40:10.511385 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 539/1045] 10.222.0.13 () {58 vars in 1413 bytes} [Sat Sep 3 01:40:10 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments/257ff041-f59d-49f6-9774-696749811cfa => generated 194 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:40:10.520856 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-848b9615-9583-4a7f-ac43-7d024e3332d9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:10.522246 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-848b9615-9583-4a7f-ac43-7d024e3332d9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:10.531169 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-848b9615-9583-4a7f-ac43-7d024e3332d9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:10.531663 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-848b9615-9583-4a7f-ac43-7d024e3332d9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:10.532106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-848b9615-9583-4a7f-ac43-7d024e3332d9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:10.532812 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-848b9615-9583-4a7f-ac43-7d024e3332d9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:10.533273 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-848b9615-9583-4a7f-ac43-7d024e3332d9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:10.533957 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-848b9615-9583-4a7f-ac43-7d024e3332d9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:10.635040 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-848b9615-9583-4a7f-ac43-7d024e3332d9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lazy-loading 'services' on Instance uuid dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:40:10.786641 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-57b796c8-bc2f-4597-af34-8d787fd6a289 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:10.787990 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-57b796c8-bc2f-4597-af34-8d787fd6a289 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:10.796674 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57b796c8-bc2f-4597-af34-8d787fd6a289 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:10.797168 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57b796c8-bc2f-4597-af34-8d787fd6a289 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:10.797603 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57b796c8-bc2f-4597-af34-8d787fd6a289 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:10.798597 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57b796c8-bc2f-4597-af34-8d787fd6a289 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:10.799239 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57b796c8-bc2f-4597-af34-8d787fd6a289 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:10.799912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57b796c8-bc2f-4597-af34-8d787fd6a289 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:10.896419 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-848b9615-9583-4a7f-ac43-7d024e3332d9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments/257ff041-f59d-49f6-9774-696749811cfa" status: 202 len: 0 microversion: 2.1 time: 0.379379 Sep 03 01:40:10.897493 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 507/1046] 10.222.0.13 () {58 vars in 1416 bytes} [Sat Sep 3 01:40:10 2022] DELETE /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments/257ff041-f59d-49f6-9774-696749811cfa => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:40:10.988273 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-57b796c8-bc2f-4597-af34-8d787fd6a289 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:10.998011 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-57b796c8-bc2f-4597-af34-8d787fd6a289 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:11.009184 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-57b796c8-bc2f-4597-af34-8d787fd6a289 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:11.009184 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-57b796c8-bc2f-4597-af34-8d787fd6a289 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1739 microversion: 2.20 time: 0.220113 Sep 03 01:40:11.009184 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 540/1047] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:10 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:12.028342 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5d809d5d-3f43-4f14-836d-8dd1389f28a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:12.029690 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5d809d5d-3f43-4f14-836d-8dd1389f28a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:12.041468 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d809d5d-3f43-4f14-836d-8dd1389f28a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:12.055585 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d809d5d-3f43-4f14-836d-8dd1389f28a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:12.056346 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d809d5d-3f43-4f14-836d-8dd1389f28a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:12.057361 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d809d5d-3f43-4f14-836d-8dd1389f28a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:12.057835 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d809d5d-3f43-4f14-836d-8dd1389f28a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:12.058271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d809d5d-3f43-4f14-836d-8dd1389f28a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:12.239993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5d809d5d-3f43-4f14-836d-8dd1389f28a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:12.254160 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5d809d5d-3f43-4f14-836d-8dd1389f28a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:12.255745 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5d809d5d-3f43-4f14-836d-8dd1389f28a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:12.257143 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5d809d5d-3f43-4f14-836d-8dd1389f28a6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1739 microversion: 2.20 time: 0.233700 Sep 03 01:40:12.268198 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 508/1048] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:12 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1739 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:13.126163 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-74b47716-fc56-4220-8974-46b958aceb05 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:13.126676 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-74b47716-fc56-4220-8974-46b958aceb05 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:13.135348 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74b47716-fc56-4220-8974-46b958aceb05 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:13.136126 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74b47716-fc56-4220-8974-46b958aceb05 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:13.136861 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74b47716-fc56-4220-8974-46b958aceb05 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:13.137761 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74b47716-fc56-4220-8974-46b958aceb05 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:13.138215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74b47716-fc56-4220-8974-46b958aceb05 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:13.138837 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74b47716-fc56-4220-8974-46b958aceb05 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:13.176195 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-74b47716-fc56-4220-8974-46b958aceb05 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments/dc5aba88-0fcb-4ec0-bffc-be82786a9fb3" status: 200 len: 194 microversion: 2.1 time: 0.053769 Sep 03 01:40:13.177081 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 541/1049] 10.222.0.13 () {58 vars in 1413 bytes} [Sat Sep 3 01:40:13 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments/dc5aba88-0fcb-4ec0-bffc-be82786a9fb3 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:40:13.195405 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-479b4544-b1b0-4062-8a16-eeeffbd1c1b9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:13.196258 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-479b4544-b1b0-4062-8a16-eeeffbd1c1b9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:13.205394 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-479b4544-b1b0-4062-8a16-eeeffbd1c1b9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:13.205899 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-479b4544-b1b0-4062-8a16-eeeffbd1c1b9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:13.206361 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-479b4544-b1b0-4062-8a16-eeeffbd1c1b9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:13.207128 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-479b4544-b1b0-4062-8a16-eeeffbd1c1b9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:13.208770 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-479b4544-b1b0-4062-8a16-eeeffbd1c1b9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:13.209907 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-479b4544-b1b0-4062-8a16-eeeffbd1c1b9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:13.288566 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-59b6bea8-26c3-474a-80a2-e6a2e6229603 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:13.290176 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-59b6bea8-26c3-474a-80a2-e6a2e6229603 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:13.307119 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-59b6bea8-26c3-474a-80a2-e6a2e6229603 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:13.308076 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-59b6bea8-26c3-474a-80a2-e6a2e6229603 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:13.308809 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-59b6bea8-26c3-474a-80a2-e6a2e6229603 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:13.311106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-59b6bea8-26c3-474a-80a2-e6a2e6229603 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:13.312060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-59b6bea8-26c3-474a-80a2-e6a2e6229603 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:13.312777 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-59b6bea8-26c3-474a-80a2-e6a2e6229603 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:13.325340 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-479b4544-b1b0-4062-8a16-eeeffbd1c1b9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lazy-loading 'services' on Instance uuid dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:40:13.498022 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-59b6bea8-26c3-474a-80a2-e6a2e6229603 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:13.509175 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-59b6bea8-26c3-474a-80a2-e6a2e6229603 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:13.510631 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-59b6bea8-26c3-474a-80a2-e6a2e6229603 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:13.511805 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-59b6bea8-26c3-474a-80a2-e6a2e6229603 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1739 microversion: 2.20 time: 0.229672 Sep 03 01:40:13.512569 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 542/1050] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:13 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:13.602702 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-479b4544-b1b0-4062-8a16-eeeffbd1c1b9 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments/dc5aba88-0fcb-4ec0-bffc-be82786a9fb3" status: 202 len: 0 microversion: 2.1 time: 0.414476 Sep 03 01:40:13.606565 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 509/1051] 10.222.0.13 () {58 vars in 1416 bytes} [Sat Sep 3 01:40:13 2022] DELETE /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments/dc5aba88-0fcb-4ec0-bffc-be82786a9fb3 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:40:14.541925 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-97a8061e-4f70-4417-ba9f-d806c35a729c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:14.542779 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-97a8061e-4f70-4417-ba9f-d806c35a729c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:14.551281 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-97a8061e-4f70-4417-ba9f-d806c35a729c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:14.555273 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-97a8061e-4f70-4417-ba9f-d806c35a729c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:14.555273 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-97a8061e-4f70-4417-ba9f-d806c35a729c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:14.555273 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-97a8061e-4f70-4417-ba9f-d806c35a729c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:14.555716 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-97a8061e-4f70-4417-ba9f-d806c35a729c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:14.556420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-97a8061e-4f70-4417-ba9f-d806c35a729c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:14.746036 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-97a8061e-4f70-4417-ba9f-d806c35a729c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:14.751886 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-97a8061e-4f70-4417-ba9f-d806c35a729c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:14.753393 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-97a8061e-4f70-4417-ba9f-d806c35a729c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:14.754708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-97a8061e-4f70-4417-ba9f-d806c35a729c tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1739 microversion: 2.20 time: 0.218070 Sep 03 01:40:14.755266 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 543/1052] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:14 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1739 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:14.825343 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-599fd933-4bf1-490a-9d4f-c3223d9a892a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:14.827917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-599fd933-4bf1-490a-9d4f-c3223d9a892a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:14.835132 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-599fd933-4bf1-490a-9d4f-c3223d9a892a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:14.835850 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-599fd933-4bf1-490a-9d4f-c3223d9a892a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:14.836542 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-599fd933-4bf1-490a-9d4f-c3223d9a892a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:14.837321 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-599fd933-4bf1-490a-9d4f-c3223d9a892a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:14.837843 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-599fd933-4bf1-490a-9d4f-c3223d9a892a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:14.838352 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-599fd933-4bf1-490a-9d4f-c3223d9a892a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:14.871723 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-599fd933-4bf1-490a-9d4f-c3223d9a892a tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052400 Sep 03 01:40:14.878669 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 510/1053] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:40:14 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 01:40:14.999648 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-23095f6d-55fa-4cb3-8a20-d1923112228d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:15.002060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-23095f6d-55fa-4cb3-8a20-d1923112228d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:15.008967 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-23095f6d-55fa-4cb3-8a20-d1923112228d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:15.009465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-23095f6d-55fa-4cb3-8a20-d1923112228d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:15.010595 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-23095f6d-55fa-4cb3-8a20-d1923112228d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:15.010712 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-23095f6d-55fa-4cb3-8a20-d1923112228d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:15.011120 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-23095f6d-55fa-4cb3-8a20-d1923112228d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:15.011728 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-23095f6d-55fa-4cb3-8a20-d1923112228d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:15.194653 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-23095f6d-55fa-4cb3-8a20-d1923112228d tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.198841 Sep 03 01:40:15.213585 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 544/1054] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:40:14 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6/os-volume_attachments => generated 25 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 01:40:15.270332 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f5a421ac-693e-402d-b9c7-ca036f2f2289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:15.270816 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f5a421ac-693e-402d-b9c7-ca036f2f2289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:15.277600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5a421ac-693e-402d-b9c7-ca036f2f2289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:15.278094 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5a421ac-693e-402d-b9c7-ca036f2f2289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:15.278571 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5a421ac-693e-402d-b9c7-ca036f2f2289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:15.279270 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5a421ac-693e-402d-b9c7-ca036f2f2289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:15.279724 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5a421ac-693e-402d-b9c7-ca036f2f2289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:15.280148 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f5a421ac-693e-402d-b9c7-ca036f2f2289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:15.307878 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f5a421ac-693e-402d-b9c7-ca036f2f2289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:40:15.573859 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f5a421ac-693e-402d-b9c7-ca036f2f2289 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 204 len: 0 microversion: 2.1 time: 0.307136 Sep 03 01:40:15.574994 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 511/1055] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:40:15 2022] DELETE /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:40:15.590699 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d4b6fda2-1d95-46e5-8093-71c7e195a733 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:15.591375 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d4b6fda2-1d95-46e5-8093-71c7e195a733 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:15.600639 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d4b6fda2-1d95-46e5-8093-71c7e195a733 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:15.601947 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d4b6fda2-1d95-46e5-8093-71c7e195a733 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:15.602929 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d4b6fda2-1d95-46e5-8093-71c7e195a733 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:15.603923 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d4b6fda2-1d95-46e5-8093-71c7e195a733 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:15.604574 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d4b6fda2-1d95-46e5-8093-71c7e195a733 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:15.605189 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d4b6fda2-1d95-46e5-8093-71c7e195a733 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:15.754467 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d4b6fda2-1d95-46e5-8093-71c7e195a733 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:15.763076 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d4b6fda2-1d95-46e5-8093-71c7e195a733 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1672 microversion: 2.1 time: 0.177140 Sep 03 01:40:15.763673 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 545/1056] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:15 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1672 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:15.787345 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ef648cb7-6d4f-48ce-826c-c54f3660a11b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:15.788096 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ef648cb7-6d4f-48ce-826c-c54f3660a11b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:15.795417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ef648cb7-6d4f-48ce-826c-c54f3660a11b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:15.795916 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ef648cb7-6d4f-48ce-826c-c54f3660a11b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:15.796360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ef648cb7-6d4f-48ce-826c-c54f3660a11b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:15.797071 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ef648cb7-6d4f-48ce-826c-c54f3660a11b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:15.797556 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ef648cb7-6d4f-48ce-826c-c54f3660a11b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:15.797988 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ef648cb7-6d4f-48ce-826c-c54f3660a11b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:15.935314 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ef648cb7-6d4f-48ce-826c-c54f3660a11b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:15.943564 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ef648cb7-6d4f-48ce-826c-c54f3660a11b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:15.945000 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ef648cb7-6d4f-48ce-826c-c54f3660a11b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:15.947007 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ef648cb7-6d4f-48ce-826c-c54f3660a11b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1739 microversion: 2.20 time: 0.165134 Sep 03 01:40:15.947822 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 512/1057] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:15 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:16.795165 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-dc119c71-44d3-4b37-ada2-a8ccb90c6d2e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:16.796572 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-dc119c71-44d3-4b37-ada2-a8ccb90c6d2e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:16.806624 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc119c71-44d3-4b37-ada2-a8ccb90c6d2e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:16.807131 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc119c71-44d3-4b37-ada2-a8ccb90c6d2e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:16.807574 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc119c71-44d3-4b37-ada2-a8ccb90c6d2e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:16.808288 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc119c71-44d3-4b37-ada2-a8ccb90c6d2e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:16.808746 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc119c71-44d3-4b37-ada2-a8ccb90c6d2e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:16.809175 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dc119c71-44d3-4b37-ada2-a8ccb90c6d2e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:16.962006 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dc119c71-44d3-4b37-ada2-a8ccb90c6d2e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:16.970498 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-dc119c71-44d3-4b37-ada2-a8ccb90c6d2e tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1672 microversion: 2.1 time: 0.179079 Sep 03 01:40:16.971507 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 546/1058] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:16 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1672 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:16.994971 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5b61bc03-ba0f-4c9f-950b-e6df72c1ac88 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:16.995756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5b61bc03-ba0f-4c9f-950b-e6df72c1ac88 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:17.005409 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5b61bc03-ba0f-4c9f-950b-e6df72c1ac88 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:17.011620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5b61bc03-ba0f-4c9f-950b-e6df72c1ac88 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:17.011620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5b61bc03-ba0f-4c9f-950b-e6df72c1ac88 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:17.011620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5b61bc03-ba0f-4c9f-950b-e6df72c1ac88 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:17.011620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5b61bc03-ba0f-4c9f-950b-e6df72c1ac88 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:17.012016 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5b61bc03-ba0f-4c9f-950b-e6df72c1ac88 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:17.154747 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5b61bc03-ba0f-4c9f-950b-e6df72c1ac88 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:17.164390 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5b61bc03-ba0f-4c9f-950b-e6df72c1ac88 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:17.166525 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5b61bc03-ba0f-4c9f-950b-e6df72c1ac88 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:17.167804 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5b61bc03-ba0f-4c9f-950b-e6df72c1ac88 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1739 microversion: 2.20 time: 0.190520 Sep 03 01:40:17.182364 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 513/1059] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:16 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:18.000015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-71a2a4e9-2eb0-40e4-b815-282f0c9c9a82 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:18.001777 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-71a2a4e9-2eb0-40e4-b815-282f0c9c9a82 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:18.010052 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71a2a4e9-2eb0-40e4-b815-282f0c9c9a82 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:18.010721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71a2a4e9-2eb0-40e4-b815-282f0c9c9a82 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:18.011164 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71a2a4e9-2eb0-40e4-b815-282f0c9c9a82 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:18.012082 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71a2a4e9-2eb0-40e4-b815-282f0c9c9a82 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:18.013229 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71a2a4e9-2eb0-40e4-b815-282f0c9c9a82 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:18.013690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-71a2a4e9-2eb0-40e4-b815-282f0c9c9a82 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:18.164723 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-71a2a4e9-2eb0-40e4-b815-282f0c9c9a82 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:18.174823 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-71a2a4e9-2eb0-40e4-b815-282f0c9c9a82 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1672 microversion: 2.1 time: 0.180949 Sep 03 01:40:18.175744 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 547/1060] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:17 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1672 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:18.197317 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a86cbea9-ec98-4ddc-aebf-4ca93d85efe2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:18.200544 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a86cbea9-ec98-4ddc-aebf-4ca93d85efe2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:18.204690 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a86cbea9-ec98-4ddc-aebf-4ca93d85efe2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:18.205244 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a86cbea9-ec98-4ddc-aebf-4ca93d85efe2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:18.205616 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a86cbea9-ec98-4ddc-aebf-4ca93d85efe2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:18.206311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a86cbea9-ec98-4ddc-aebf-4ca93d85efe2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:18.206958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a86cbea9-ec98-4ddc-aebf-4ca93d85efe2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:18.207383 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a86cbea9-ec98-4ddc-aebf-4ca93d85efe2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:18.469621 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a86cbea9-ec98-4ddc-aebf-4ca93d85efe2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:18.479680 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a86cbea9-ec98-4ddc-aebf-4ca93d85efe2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:18.484283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a86cbea9-ec98-4ddc-aebf-4ca93d85efe2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:18.485712 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a86cbea9-ec98-4ddc-aebf-4ca93d85efe2 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1739 microversion: 2.20 time: 0.293152 Sep 03 01:40:18.486840 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 514/1061] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:18 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:18.693062 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-f5d46bfc-0637-4560-a2ea-40a26da6f0b0 req-93eff37a-360c-49be-b46a-0f1485c11a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6", "name": "network-vif-deleted", "tag": "032bf397-9317-48c8-8b99-bddb13c489ed"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:40:18.705844 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-f5d46bfc-0637-4560-a2ea-40a26da6f0b0 req-93eff37a-360c-49be-b46a-0f1485c11a13 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:18.706355 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-f5d46bfc-0637-4560-a2ea-40a26da6f0b0 req-93eff37a-360c-49be-b46a-0f1485c11a13 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:18.709016 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-f5d46bfc-0637-4560-a2ea-40a26da6f0b0 req-93eff37a-360c-49be-b46a-0f1485c11a13 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:18.714821 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=100 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:18.723561 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-f5d46bfc-0637-4560-a2ea-40a26da6f0b0 req-93eff37a-360c-49be-b46a-0f1485c11a13 service nova] Creating event network-vif-deleted:032bf397-9317-48c8-8b99-bddb13c489ed for instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 on hv-cinder-83800 Sep 03 01:40:18.728875 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-f5d46bfc-0637-4560-a2ea-40a26da6f0b0 req-93eff37a-360c-49be-b46a-0f1485c11a13 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040001 Sep 03 01:40:18.732708 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 548/1062] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:40:19.199910 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:19.201376 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:19.208610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:19.209502 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:19.210159 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:19.211932 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:19.212642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:19.213285 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:19.218490 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=4 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:19.252045 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:19.252966 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:19.253412 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:19.253874 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lazy-loading 'fault' on Instance uuid dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:40:19.317600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecf076dde874415aa734644f27a10b4b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53cde5b369084772897d46c38b083d8f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:19.327791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-40baa7ac-4cb4-4072-8243-80cd13bb81a4 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 200 len: 1326 microversion: 2.1 time: 0.131760 Sep 03 01:40:19.328393 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 515/1063] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:19 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 1326 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:19.514631 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-41d7dcdd-8ef6-41ab-b700-081fa290f86b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:19.515338 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-41d7dcdd-8ef6-41ab-b700-081fa290f86b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:19.532866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-41d7dcdd-8ef6-41ab-b700-081fa290f86b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:19.532866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-41d7dcdd-8ef6-41ab-b700-081fa290f86b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:19.532866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-41d7dcdd-8ef6-41ab-b700-081fa290f86b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:19.532866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-41d7dcdd-8ef6-41ab-b700-081fa290f86b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:19.533303 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-41d7dcdd-8ef6-41ab-b700-081fa290f86b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:19.533303 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-41d7dcdd-8ef6-41ab-b700-081fa290f86b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:19.669397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-41d7dcdd-8ef6-41ab-b700-081fa290f86b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:19.677880 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-41d7dcdd-8ef6-41ab-b700-081fa290f86b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:19.681233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-41d7dcdd-8ef6-41ab-b700-081fa290f86b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:19.681233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-41d7dcdd-8ef6-41ab-b700-081fa290f86b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1739 microversion: 2.20 time: 0.171651 Sep 03 01:40:19.681642 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 549/1064] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:19 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:20.352615 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ffcf5907-7aaa-4d5a-bc93-4f583b099d07 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:20.353246 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ffcf5907-7aaa-4d5a-bc93-4f583b099d07 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:20.361231 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ffcf5907-7aaa-4d5a-bc93-4f583b099d07 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:20.362124 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ffcf5907-7aaa-4d5a-bc93-4f583b099d07 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:20.362688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ffcf5907-7aaa-4d5a-bc93-4f583b099d07 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:20.363650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ffcf5907-7aaa-4d5a-bc93-4f583b099d07 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:20.364314 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ffcf5907-7aaa-4d5a-bc93-4f583b099d07 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:20.364841 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ffcf5907-7aaa-4d5a-bc93-4f583b099d07 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:20.379749 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-ffcf5907-7aaa-4d5a-bc93-4f583b099d07 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] HTTP exception thrown: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ffcf5907-7aaa-4d5a-bc93-4f583b099d07 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Request method failure captured: Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 HTTP/1.1 Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7Wua9M8FNfKrIFZ0-WQPUJXfLRBZqXcHwy-Q3Wu16LCvbiEdSxvcWC5PxoaIuhHJ4tIyi5pkH76o-vxO929lRiI3JFjjdJ6zDldYhLE7t79CHFseQWQyf33DaTLD_Mdl-CjYL8DSGor2tNh__MkSD8J686LSZDTLk8zuckFVSCMcA Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 53cde5b369084772897d46c38b083d8f Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:40:20.381691 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:40:20.384087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_53cde5b369084772897d46c38b083d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/53cde5b369084772897d46c38b083d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53cde5b369084772897d46c38b083d8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53cde5b369084772897d46c38b083d8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:40:20.384087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:20.384087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 53cde5b369084772897d46c38b083d8f Sep 03 01:40:20.384087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:20.384087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-AttachVolumeTestJSON-419470651-project Sep 03 01:40:20.384087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:40:20.384087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:40:20.384087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: ecf076dde874415aa734644f27a10b4b Sep 03 01:40:20.384087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-AttachVolumeTestJSON-419470651-project Sep 03 01:40:20.384087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:40:20.384087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:20.384087 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': 'dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6'} Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:40:20.385017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:20.386629 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:20.387848 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ffcf5907-7aaa-4d5a-bc93-4f583b099d07 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Returning 404 to user: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:40:20.387848 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ffcf5907-7aaa-4d5a-bc93-4f583b099d07 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 404 len: 111 microversion: 2.1 time: 0.036475 Sep 03 01:40:20.387848 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 516/1065] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:20 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:40:20.395147 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3596031f-c236-4bdd-9d67-e7d7b6f34720 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '.version_select at 0x7f6d2819c700>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:20.494683 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3596031f-c236-4bdd-9d67-e7d7b6f34720 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-273682236" status: 202 len: 0 microversion: 2.1 time: 0.103216 Sep 03 01:40:20.495576 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 550/1066] 10.222.0.13 () {58 vars in 1218 bytes} [Sat Sep 3 01:40:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-273682236 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 03 01:40:20.712135 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1008562a-8172-486f-af30-2c5368c4c318 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:20.712664 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1008562a-8172-486f-af30-2c5368c4c318 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:20.719001 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1008562a-8172-486f-af30-2c5368c4c318 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:20.719492 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1008562a-8172-486f-af30-2c5368c4c318 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:20.719933 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1008562a-8172-486f-af30-2c5368c4c318 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:20.720625 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1008562a-8172-486f-af30-2c5368c4c318 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:20.721083 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1008562a-8172-486f-af30-2c5368c4c318 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:20.721512 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1008562a-8172-486f-af30-2c5368c4c318 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:20.873368 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1008562a-8172-486f-af30-2c5368c4c318 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:20.881738 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1008562a-8172-486f-af30-2c5368c4c318 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:20.884172 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1008562a-8172-486f-af30-2c5368c4c318 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:20.885345 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1008562a-8172-486f-af30-2c5368c4c318 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1739 microversion: 2.20 time: 0.178352 Sep 03 01:40:20.885901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 517/1067] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:20 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:21.914549 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a2a89294-b9f5-43dd-a347-611c6a05bd2b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:21.915990 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a2a89294-b9f5-43dd-a347-611c6a05bd2b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:21.918580 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:21.924086 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a2a89294-b9f5-43dd-a347-611c6a05bd2b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:21.924610 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a2a89294-b9f5-43dd-a347-611c6a05bd2b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:21.925061 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a2a89294-b9f5-43dd-a347-611c6a05bd2b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:21.925761 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a2a89294-b9f5-43dd-a347-611c6a05bd2b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:21.926223 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a2a89294-b9f5-43dd-a347-611c6a05bd2b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:21.926679 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a2a89294-b9f5-43dd-a347-611c6a05bd2b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:22.065116 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a2a89294-b9f5-43dd-a347-611c6a05bd2b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:22.075014 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a2a89294-b9f5-43dd-a347-611c6a05bd2b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:22.076619 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a2a89294-b9f5-43dd-a347-611c6a05bd2b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:22.078030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a2a89294-b9f5-43dd-a347-611c6a05bd2b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1721 microversion: 2.20 time: 0.169261 Sep 03 01:40:22.078621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 551/1068] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:21 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:23.106023 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cb829f03-9264-4145-a17f-da717cf637bc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:23.106655 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-cb829f03-9264-4145-a17f-da717cf637bc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:23.109960 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:23.113399 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb829f03-9264-4145-a17f-da717cf637bc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:23.114009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb829f03-9264-4145-a17f-da717cf637bc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:23.114438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb829f03-9264-4145-a17f-da717cf637bc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:23.115127 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb829f03-9264-4145-a17f-da717cf637bc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:23.115579 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb829f03-9264-4145-a17f-da717cf637bc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:23.116000 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb829f03-9264-4145-a17f-da717cf637bc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:23.248228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cb829f03-9264-4145-a17f-da717cf637bc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:23.256241 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cb829f03-9264-4145-a17f-da717cf637bc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:23.258203 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cb829f03-9264-4145-a17f-da717cf637bc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:23.259385 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-cb829f03-9264-4145-a17f-da717cf637bc tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1721 microversion: 2.20 time: 0.157199 Sep 03 01:40:23.259934 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 518/1069] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:23 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:24.141180 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a6a1b919-5dc4-4be2-ade1-956a13f9103b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:24.141688 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a6a1b919-5dc4-4be2-ade1-956a13f9103b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:24.148743 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a6a1b919-5dc4-4be2-ade1-956a13f9103b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:24.149233 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a6a1b919-5dc4-4be2-ade1-956a13f9103b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:24.149676 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a6a1b919-5dc4-4be2-ade1-956a13f9103b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:24.150397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a6a1b919-5dc4-4be2-ade1-956a13f9103b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:24.150857 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a6a1b919-5dc4-4be2-ade1-956a13f9103b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:24.151291 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a6a1b919-5dc4-4be2-ade1-956a13f9103b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:24.165070 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-a6a1b919-5dc4-4be2-ade1-956a13f9103b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] HTTP exception thrown: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a6a1b919-5dc4-4be2-ade1-956a13f9103b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Request method failure captured: Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: DELETE /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 HTTP/1.1 Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7Wua9M8FNfKrIFZ0-WQPUJXfLRBZqXcHwy-Q3Wu16LCvbiEdSxvcWC5PxoaIuhHJ4tIyi5pkH76o-vxO929lRiI3JFjjdJ6zDldYhLE7t79CHFseQWQyf33DaTLD_Mdl-CjYL8DSGor2tNh__MkSD8J686LSZDTLk8zuckFVSCMcA Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 53cde5b369084772897d46c38b083d8f Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:40:24.166776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:40:24.168415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_53cde5b369084772897d46c38b083d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/53cde5b369084772897d46c38b083d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53cde5b369084772897d46c38b083d8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53cde5b369084772897d46c38b083d8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:40:24.168415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:24.168415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 53cde5b369084772897d46c38b083d8f Sep 03 01:40:24.168415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:24.168415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-AttachVolumeTestJSON-419470651-project Sep 03 01:40:24.168415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:40:24.168415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:40:24.168415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: ecf076dde874415aa734644f27a10b4b Sep 03 01:40:24.168415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-AttachVolumeTestJSON-419470651-project Sep 03 01:40:24.168415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:40:24.168415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:24.168415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': 'dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6'} Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:40:24.169210 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:24.170515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:40:24.171723 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a6a1b919-5dc4-4be2-ade1-956a13f9103b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Returning 404 to user: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:40:24.171723 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a6a1b919-5dc4-4be2-ade1-956a13f9103b tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "DELETE /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 404 len: 111 microversion: 2.1 time: 0.031246 Sep 03 01:40:24.171723 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 552/1070] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:40:24 2022] DELETE /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:40:24.176931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-30a6a0ed-1621-4eee-b04f-1ac59b41360f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:24.177533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-30a6a0ed-1621-4eee-b04f-1ac59b41360f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:24.184582 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-30a6a0ed-1621-4eee-b04f-1ac59b41360f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:24.185009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-30a6a0ed-1621-4eee-b04f-1ac59b41360f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:24.185436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-30a6a0ed-1621-4eee-b04f-1ac59b41360f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:24.186115 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-30a6a0ed-1621-4eee-b04f-1ac59b41360f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:24.186675 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-30a6a0ed-1621-4eee-b04f-1ac59b41360f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:24.187097 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-30a6a0ed-1621-4eee-b04f-1ac59b41360f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:24.200766 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-30a6a0ed-1621-4eee-b04f-1ac59b41360f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] HTTP exception thrown: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-30a6a0ed-1621-4eee-b04f-1ac59b41360f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Request method failure captured: Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 HTTP/1.1 Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7Wua9M8FNfKrIFZ0-WQPUJXfLRBZqXcHwy-Q3Wu16LCvbiEdSxvcWC5PxoaIuhHJ4tIyi5pkH76o-vxO929lRiI3JFjjdJ6zDldYhLE7t79CHFseQWQyf33DaTLD_Mdl-CjYL8DSGor2tNh__MkSD8J686LSZDTLk8zuckFVSCMcA Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 53cde5b369084772897d46c38b083d8f Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:40:24.202269 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:40:24.203886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_53cde5b369084772897d46c38b083d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/53cde5b369084772897d46c38b083d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53cde5b369084772897d46c38b083d8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53cde5b369084772897d46c38b083d8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:40:24.203886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:24.203886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 53cde5b369084772897d46c38b083d8f Sep 03 01:40:24.203886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:24.203886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-AttachVolumeTestJSON-419470651-project Sep 03 01:40:24.203886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:40:24.203886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:40:24.203886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: ecf076dde874415aa734644f27a10b4b Sep 03 01:40:24.203886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-AttachVolumeTestJSON-419470651-project Sep 03 01:40:24.203886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:40:24.203886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:24.203886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': 'dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6'} Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:40:24.204776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. Sep 03 01:40:24.206261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:24.207578 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-30a6a0ed-1621-4eee-b04f-1ac59b41360f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Returning 404 to user: Instance dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:40:24.207578 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-30a6a0ed-1621-4eee-b04f-1ac59b41360f tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6" status: 404 len: 111 microversion: 2.1 time: 0.030623 Sep 03 01:40:24.207578 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 519/1071] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:24 2022] GET /compute/v2.1/servers/dbd44b33-bedc-4a33-a5f0-0ffa8433d0a6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:40:24.286762 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-81f59001-c653-4a42-8ed0-e7810788e962 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:24.287374 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-81f59001-c653-4a42-8ed0-e7810788e962 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:24.293418 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-81f59001-c653-4a42-8ed0-e7810788e962 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:24.293900 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-81f59001-c653-4a42-8ed0-e7810788e962 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:24.294359 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-81f59001-c653-4a42-8ed0-e7810788e962 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:24.295057 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-81f59001-c653-4a42-8ed0-e7810788e962 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:24.295506 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-81f59001-c653-4a42-8ed0-e7810788e962 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:24.295929 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-81f59001-c653-4a42-8ed0-e7810788e962 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:24.427393 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-81f59001-c653-4a42-8ed0-e7810788e962 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:24.436824 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-81f59001-c653-4a42-8ed0-e7810788e962 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:24.438962 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-81f59001-c653-4a42-8ed0-e7810788e962 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:24.441149 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-81f59001-c653-4a42-8ed0-e7810788e962 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1724 microversion: 2.20 time: 0.158693 Sep 03 01:40:24.442136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 553/1072] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:24 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:24.467568 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-defd242e-f881-48dd-bfd7-34c5d6017b51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "464e3ce0-29c4-475a-8111-ced2d18e1662"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:40:24.470062 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-defd242e-f881-48dd-bfd7-34c5d6017b51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:24.476995 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-defd242e-f881-48dd-bfd7-34c5d6017b51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:24.477487 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-defd242e-f881-48dd-bfd7-34c5d6017b51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:24.477926 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-defd242e-f881-48dd-bfd7-34c5d6017b51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:24.478667 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-defd242e-f881-48dd-bfd7-34c5d6017b51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:24.479176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-defd242e-f881-48dd-bfd7-34c5d6017b51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:24.479604 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-defd242e-f881-48dd-bfd7-34c5d6017b51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:25.360528 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-defd242e-f881-48dd-bfd7-34c5d6017b51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "POST /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.897000 Sep 03 01:40:25.361171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 520/1073] 10.222.0.13 () {62 vars in 1364 bytes} [Sat Sep 3 01:40:24 2022] POST /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/os-volume_attachments => generated 188 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 03 01:40:25.493160 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-283ea63d-c9f0-42fa-b2e6-0a3c0e881e20 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:25.493663 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-283ea63d-c9f0-42fa-b2e6-0a3c0e881e20 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:25.500254 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-283ea63d-c9f0-42fa-b2e6-0a3c0e881e20 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:25.500749 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-283ea63d-c9f0-42fa-b2e6-0a3c0e881e20 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:25.501190 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-283ea63d-c9f0-42fa-b2e6-0a3c0e881e20 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:25.501883 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-283ea63d-c9f0-42fa-b2e6-0a3c0e881e20 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:25.502349 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-283ea63d-c9f0-42fa-b2e6-0a3c0e881e20 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:25.502782 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-283ea63d-c9f0-42fa-b2e6-0a3c0e881e20 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:25.504799 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-67cf8052-43df-4542-a10e-a225358fcbbe tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:25.505299 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-67cf8052-43df-4542-a10e-a225358fcbbe tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:25.511578 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-67cf8052-43df-4542-a10e-a225358fcbbe tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:25.512345 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-67cf8052-43df-4542-a10e-a225358fcbbe tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:25.512837 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-67cf8052-43df-4542-a10e-a225358fcbbe tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:25.513468 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-67cf8052-43df-4542-a10e-a225358fcbbe tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:25.513919 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-67cf8052-43df-4542-a10e-a225358fcbbe tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:25.514372 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-67cf8052-43df-4542-a10e-a225358fcbbe tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:25.530022 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-67cf8052-43df-4542-a10e-a225358fcbbe tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] HTTP exception thrown: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-67cf8052-43df-4542-a10e-a225358fcbbe tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Request method failure captured: Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: DELETE /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f HTTP/1.1 Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7Wua9M8FNfKrIFZ0-WQPUJXfLRBZqXcHwy-Q3Wu16LCvbiEdSxvcWC5PxoaIuhHJ4tIyi5pkH76o-vxO929lRiI3JFjjdJ6zDldYhLE7t79CHFseQWQyf33DaTLD_Mdl-CjYL8DSGor2tNh__MkSD8J686LSZDTLk8zuckFVSCMcA Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 53cde5b369084772897d46c38b083d8f Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:40:25.531623 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:40:25.532972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_53cde5b369084772897d46c38b083d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/53cde5b369084772897d46c38b083d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53cde5b369084772897d46c38b083d8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53cde5b369084772897d46c38b083d8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:40:25.532972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:25.532972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 53cde5b369084772897d46c38b083d8f Sep 03 01:40:25.532972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:25.532972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-AttachVolumeTestJSON-419470651-project Sep 03 01:40:25.532972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:40:25.532972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:40:25.532972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: ecf076dde874415aa734644f27a10b4b Sep 03 01:40:25.532972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-AttachVolumeTestJSON-419470651-project Sep 03 01:40:25.532972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:40:25.532972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:40:25.532972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': 'a0fef20f-3dfd-4d65-b5ed-50f3caaa011f'} Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:40:25.533713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:40:25.535252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:25.536486 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-67cf8052-43df-4542-a10e-a225358fcbbe tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Returning 404 to user: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:40:25.536486 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-67cf8052-43df-4542-a10e-a225358fcbbe tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 404 len: 111 microversion: 2.1 time: 0.032093 Sep 03 01:40:25.536486 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 521/1074] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:40:25 2022] DELETE /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 01:40:25.542423 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cb0b6433-0ea0-4e3b-b171-a82cd05149b6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:25.543041 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-cb0b6433-0ea0-4e3b-b171-a82cd05149b6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] [instance: a0fef20f-3dfd-4d65-b5ed-50f3caaa011f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:25.549261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb0b6433-0ea0-4e3b-b171-a82cd05149b6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:25.549751 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb0b6433-0ea0-4e3b-b171-a82cd05149b6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:25.550429 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb0b6433-0ea0-4e3b-b171-a82cd05149b6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:25.550911 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb0b6433-0ea0-4e3b-b171-a82cd05149b6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:25.551361 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb0b6433-0ea0-4e3b-b171-a82cd05149b6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:25.551783 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cb0b6433-0ea0-4e3b-b171-a82cd05149b6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:25.565781 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-cb0b6433-0ea0-4e3b-b171-a82cd05149b6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] HTTP exception thrown: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cb0b6433-0ea0-4e3b-b171-a82cd05149b6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Request method failure captured: Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f HTTP/1.1 Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7Wua9M8FNfKrIFZ0-WQPUJXfLRBZqXcHwy-Q3Wu16LCvbiEdSxvcWC5PxoaIuhHJ4tIyi5pkH76o-vxO929lRiI3JFjjdJ6zDldYhLE7t79CHFseQWQyf33DaTLD_Mdl-CjYL8DSGor2tNh__MkSD8J686LSZDTLk8zuckFVSCMcA Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 53cde5b369084772897d46c38b083d8f Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:40:25.567499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:40:25.569176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_53cde5b369084772897d46c38b083d8f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/53cde5b369084772897d46c38b083d8f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53cde5b369084772897d46c38b083d8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53cde5b369084772897d46c38b083d8f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:40:25.569176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:25.569176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 53cde5b369084772897d46c38b083d8f Sep 03 01:40:25.569176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-AttachVolumeTestJSON-419470651 Sep 03 01:40:25.569176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-AttachVolumeTestJSON-419470651-project Sep 03 01:40:25.569176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:40:25.569176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:40:25.569176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: ecf076dde874415aa734644f27a10b4b Sep 03 01:40:25.569176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-AttachVolumeTestJSON-419470651-project Sep 03 01:40:25.569176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:40:25.569176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:40:25.569176 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': 'a0fef20f-3dfd-4d65-b5ed-50f3caaa011f'} Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:40:25.570104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. Sep 03 01:40:25.571548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:40:25.572914 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cb0b6433-0ea0-4e3b-b171-a82cd05149b6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] Returning 404 to user: Instance a0fef20f-3dfd-4d65-b5ed-50f3caaa011f could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:40:25.572914 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-cb0b6433-0ea0-4e3b-b171-a82cd05149b6 tempest-AttachVolumeTestJSON-419470651 tempest-AttachVolumeTestJSON-419470651-project] 10.222.0.13 "GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f" status: 404 len: 111 microversion: 2.1 time: 0.031143 Sep 03 01:40:25.572914 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 522/1075] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:25 2022] GET /compute/v2.1/servers/a0fef20f-3dfd-4d65-b5ed-50f3caaa011f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:40:25.643792 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-d9028705-ed37-4ce4-ab14-c107d1b92dd9 req-2de8b31e-7341-4610-afb6-54a4d662eddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e156f97d-5465-4597-a836-c70692edfd41", "name": "network-vif-unplugged", "status": "completed", "tag": "b4585caf-c260-4618-ba71-326b4c35ffdf"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:40:25.654072 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-d9028705-ed37-4ce4-ab14-c107d1b92dd9 req-2de8b31e-7341-4610-afb6-54a4d662eddc service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:25.654653 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-d9028705-ed37-4ce4-ab14-c107d1b92dd9 req-2de8b31e-7341-4610-afb6-54a4d662eddc service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:25.654986 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-d9028705-ed37-4ce4-ab14-c107d1b92dd9 req-2de8b31e-7341-4610-afb6-54a4d662eddc service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:25.667059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.compute.server_external_events [req-d9028705-ed37-4ce4-ab14-c107d1b92dd9 req-2de8b31e-7341-4610-afb6-54a4d662eddc service nova] Unable to find a host for instance e156f97d-5465-4597-a836-c70692edfd41. Dropping event network-vif-unplugged {{(pid=127553) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 03 01:40:25.672504 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-d9028705-ed37-4ce4-ab14-c107d1b92dd9 req-2de8b31e-7341-4610-afb6-54a4d662eddc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028127 Sep 03 01:40:25.673121 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 523/1076] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 03 01:40:26.132966 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-aa1c337f-dc34-47d2-92da-8932bce676f4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:26.133521 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-aa1c337f-dc34-47d2-92da-8932bce676f4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:26.141797 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa1c337f-dc34-47d2-92da-8932bce676f4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:26.142421 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa1c337f-dc34-47d2-92da-8932bce676f4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:26.142850 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa1c337f-dc34-47d2-92da-8932bce676f4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:26.143744 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa1c337f-dc34-47d2-92da-8932bce676f4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:26.144363 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-283ea63d-c9f0-42fa-b2e6-0a3c0e881e20 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/os-volume_attachments/464e3ce0-29c4-475a-8111-ced2d18e1662" status: 202 len: 0 microversion: 2.20 time: 0.655721 Sep 03 01:40:26.144508 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa1c337f-dc34-47d2-92da-8932bce676f4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:26.144779 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-aa1c337f-dc34-47d2-92da-8932bce676f4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:26.145218 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 554/1077] 10.222.0.13 () {60 vars in 1457 bytes} [Sat Sep 3 01:40:25 2022] DELETE /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/os-volume_attachments/464e3ce0-29c4-475a-8111-ced2d18e1662 => generated 0 bytes in 657 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:40:26.179982 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-aa1c337f-dc34-47d2-92da-8932bce676f4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:40:26.212796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-1252018b-adac-401f-b78b-e39f63fff81a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:40:26.213515 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-1252018b-adac-401f-b78b-e39f63fff81a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:26.220252 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1252018b-adac-401f-b78b-e39f63fff81a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:26.220735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1252018b-adac-401f-b78b-e39f63fff81a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:26.221166 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1252018b-adac-401f-b78b-e39f63fff81a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:26.221858 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1252018b-adac-401f-b78b-e39f63fff81a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:26.222316 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1252018b-adac-401f-b78b-e39f63fff81a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:26.222895 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1252018b-adac-401f-b78b-e39f63fff81a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:26.252937 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-1252018b-adac-401f-b78b-e39f63fff81a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127552) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 03 01:40:26.482136 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-aa1c337f-dc34-47d2-92da-8932bce676f4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "DELETE /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 204 len: 0 microversion: 2.1 time: 0.354107 Sep 03 01:40:26.482851 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 524/1078] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:40:26 2022] DELETE /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 01:40:26.491467 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-58499468-f708-41f6-b264-8aa571b837d7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:26.492334 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-58499468-f708-41f6-b264-8aa571b837d7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:26.498670 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-58499468-f708-41f6-b264-8aa571b837d7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:26.499162 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-58499468-f708-41f6-b264-8aa571b837d7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:26.499642 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-58499468-f708-41f6-b264-8aa571b837d7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:26.500338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-58499468-f708-41f6-b264-8aa571b837d7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:26.500787 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-58499468-f708-41f6-b264-8aa571b837d7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:26.501207 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-58499468-f708-41f6-b264-8aa571b837d7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:26.536771 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-1252018b-adac-401f-b78b-e39f63fff81a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "POST /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/action" status: 202 len: 0 microversion: 2.20 time: 0.327651 Sep 03 01:40:26.539164 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 555/1079] 10.222.0.13 () {62 vars in 1319 bytes} [Sat Sep 3 01:40:26 2022] POST /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 03 01:40:26.548702 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5f16dc4a-4073-4bdb-81ed-33d93de1f724 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:26.549721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5f16dc4a-4073-4bdb-81ed-33d93de1f724 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:26.558140 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f16dc4a-4073-4bdb-81ed-33d93de1f724 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:26.558894 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f16dc4a-4073-4bdb-81ed-33d93de1f724 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:26.559494 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f16dc4a-4073-4bdb-81ed-33d93de1f724 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:26.560352 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f16dc4a-4073-4bdb-81ed-33d93de1f724 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:26.561090 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f16dc4a-4073-4bdb-81ed-33d93de1f724 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:26.561737 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f16dc4a-4073-4bdb-81ed-33d93de1f724 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:26.652861 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-58499468-f708-41f6-b264-8aa571b837d7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:26.661184 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-58499468-f708-41f6-b264-8aa571b837d7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1577 microversion: 2.1 time: 0.173925 Sep 03 01:40:26.661893 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 525/1080] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:26 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:40:26.752120 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5f16dc4a-4073-4bdb-81ed-33d93de1f724 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:26.771912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5f16dc4a-4073-4bdb-81ed-33d93de1f724 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:26.774254 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5f16dc4a-4073-4bdb-81ed-33d93de1f724 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:26.775743 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5f16dc4a-4073-4bdb-81ed-33d93de1f724 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1672 microversion: 2.20 time: 0.232433 Sep 03 01:40:26.776487 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 556/1081] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:26 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1672 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:40:27.686007 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ed434991-1dfd-4356-b84c-78e179146e22 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:27.687313 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ed434991-1dfd-4356-b84c-78e179146e22 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:27.697860 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ed434991-1dfd-4356-b84c-78e179146e22 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:27.698644 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ed434991-1dfd-4356-b84c-78e179146e22 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:27.699239 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ed434991-1dfd-4356-b84c-78e179146e22 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:27.700161 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ed434991-1dfd-4356-b84c-78e179146e22 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:27.700783 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ed434991-1dfd-4356-b84c-78e179146e22 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:27.701555 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ed434991-1dfd-4356-b84c-78e179146e22 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:27.803166 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f568d425-4fb6-4dc3-850f-80bce4f5ff81 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:27.807431 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f568d425-4fb6-4dc3-850f-80bce4f5ff81 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:27.816585 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f568d425-4fb6-4dc3-850f-80bce4f5ff81 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:27.816999 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f568d425-4fb6-4dc3-850f-80bce4f5ff81 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:27.818028 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f568d425-4fb6-4dc3-850f-80bce4f5ff81 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:27.818837 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f568d425-4fb6-4dc3-850f-80bce4f5ff81 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:27.819291 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f568d425-4fb6-4dc3-850f-80bce4f5ff81 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:27.821379 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f568d425-4fb6-4dc3-850f-80bce4f5ff81 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:27.924833 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ed434991-1dfd-4356-b84c-78e179146e22 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:27.932659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ed434991-1dfd-4356-b84c-78e179146e22 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1577 microversion: 2.1 time: 0.251786 Sep 03 01:40:27.944346 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 526/1082] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:27 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1577 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:28.073790 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f568d425-4fb6-4dc3-850f-80bce4f5ff81 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:28.081983 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f568d425-4fb6-4dc3-850f-80bce4f5ff81 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:28.084697 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f568d425-4fb6-4dc3-850f-80bce4f5ff81 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:28.084697 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f568d425-4fb6-4dc3-850f-80bce4f5ff81 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1672 microversion: 2.20 time: 0.287359 Sep 03 01:40:28.085240 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 557/1083] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:27 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1672 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:40:28.956224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5f2bef1e-4f1e-41ce-83ce-6bb554bfefa4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:28.956842 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5f2bef1e-4f1e-41ce-83ce-6bb554bfefa4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:28.965998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5f2bef1e-4f1e-41ce-83ce-6bb554bfefa4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:28.967433 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5f2bef1e-4f1e-41ce-83ce-6bb554bfefa4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:28.967766 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5f2bef1e-4f1e-41ce-83ce-6bb554bfefa4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:28.968439 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5f2bef1e-4f1e-41ce-83ce-6bb554bfefa4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:28.968926 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5f2bef1e-4f1e-41ce-83ce-6bb554bfefa4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:28.969493 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5f2bef1e-4f1e-41ce-83ce-6bb554bfefa4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:29.098037 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5f2bef1e-4f1e-41ce-83ce-6bb554bfefa4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:29.111425 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5f2bef1e-4f1e-41ce-83ce-6bb554bfefa4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1509 microversion: 2.1 time: 0.159042 Sep 03 01:40:29.112018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 527/1084] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:28 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:29.113710 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cb4fe30f-0a68-492b-bb0d-55819ee3836a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:29.117055 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cb4fe30f-0a68-492b-bb0d-55819ee3836a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:29.124852 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cb4fe30f-0a68-492b-bb0d-55819ee3836a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:29.125335 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cb4fe30f-0a68-492b-bb0d-55819ee3836a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:29.125767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cb4fe30f-0a68-492b-bb0d-55819ee3836a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:29.126487 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cb4fe30f-0a68-492b-bb0d-55819ee3836a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:29.128171 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cb4fe30f-0a68-492b-bb0d-55819ee3836a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:29.128601 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cb4fe30f-0a68-492b-bb0d-55819ee3836a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:29.389892 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cb4fe30f-0a68-492b-bb0d-55819ee3836a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:29.408561 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cb4fe30f-0a68-492b-bb0d-55819ee3836a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:29.410354 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cb4fe30f-0a68-492b-bb0d-55819ee3836a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:29.412048 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-1f6c3780-6743-445e-98dc-f92679bd7d99 req-3f55b072-9f9f-4751-88a6-2cd330711471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "843467ed-5454-46d9-8626-619ff8f27fd9", "name": "network-vif-deleted", "tag": "f3456acb-4580-4e62-9494-7b8fd05f264e"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:40:29.416716 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cb4fe30f-0a68-492b-bb0d-55819ee3836a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.309276 Sep 03 01:40:29.417894 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 558/1085] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:29 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:40:29.432741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-1f6c3780-6743-445e-98dc-f92679bd7d99 req-3f55b072-9f9f-4751-88a6-2cd330711471 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:29.433509 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-1f6c3780-6743-445e-98dc-f92679bd7d99 req-3f55b072-9f9f-4751-88a6-2cd330711471 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:29.434166 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-1f6c3780-6743-445e-98dc-f92679bd7d99 req-3f55b072-9f9f-4751-88a6-2cd330711471 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:29.458829 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-1f6c3780-6743-445e-98dc-f92679bd7d99 req-3f55b072-9f9f-4751-88a6-2cd330711471 service nova] Creating event network-vif-deleted:f3456acb-4580-4e62-9494-7b8fd05f264e for instance 843467ed-5454-46d9-8626-619ff8f27fd9 on hv-cinder-83800 Sep 03 01:40:29.467605 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-1f6c3780-6743-445e-98dc-f92679bd7d99 req-3f55b072-9f9f-4751-88a6-2cd330711471 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061850 Sep 03 01:40:29.468699 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 528/1086] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:40:30.139488 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:30.140091 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:30.147430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:30.148008 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:30.148771 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:30.149540 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:30.150003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:30.150467 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:30.184380 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:30.184871 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:30.185316 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:30.185902 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lazy-loading 'fault' on Instance uuid 843467ed-5454-46d9-8626-619ff8f27fd9 {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:40:30.243037 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:30.252092 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-79715fcb-12f3-454d-9605-7dff9e486bd2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 200 len: 1229 microversion: 2.1 time: 0.116386 Sep 03 01:40:30.252830 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 559/1087] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:30 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 1229 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:30.446318 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-29e93f36-920e-46d5-98a9-e0c8b120f1b7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:30.447474 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-29e93f36-920e-46d5-98a9-e0c8b120f1b7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:30.455956 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-29e93f36-920e-46d5-98a9-e0c8b120f1b7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:30.456701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-29e93f36-920e-46d5-98a9-e0c8b120f1b7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:30.457384 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-29e93f36-920e-46d5-98a9-e0c8b120f1b7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:30.458298 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-29e93f36-920e-46d5-98a9-e0c8b120f1b7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:30.459415 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-29e93f36-920e-46d5-98a9-e0c8b120f1b7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:30.460464 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-29e93f36-920e-46d5-98a9-e0c8b120f1b7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:30.625706 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-29e93f36-920e-46d5-98a9-e0c8b120f1b7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:30.639035 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-29e93f36-920e-46d5-98a9-e0c8b120f1b7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:30.648670 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-29e93f36-920e-46d5-98a9-e0c8b120f1b7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:30.650485 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-29e93f36-920e-46d5-98a9-e0c8b120f1b7 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.209224 Sep 03 01:40:30.651835 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 529/1088] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:30 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:31.281429 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9af3a564-9e2e-4c44-9ea2-7a4d3d37419e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:31.282128 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9af3a564-9e2e-4c44-9ea2-7a4d3d37419e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:31.289644 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9af3a564-9e2e-4c44-9ea2-7a4d3d37419e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:31.291307 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9af3a564-9e2e-4c44-9ea2-7a4d3d37419e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:31.292014 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9af3a564-9e2e-4c44-9ea2-7a4d3d37419e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:31.292977 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9af3a564-9e2e-4c44-9ea2-7a4d3d37419e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:31.293722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9af3a564-9e2e-4c44-9ea2-7a4d3d37419e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:31.294203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9af3a564-9e2e-4c44-9ea2-7a4d3d37419e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:31.309454 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-9af3a564-9e2e-4c44-9ea2-7a4d3d37419e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] HTTP exception thrown: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9af3a564-9e2e-4c44-9ea2-7a4d3d37419e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Request method failure captured: Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 HTTP/1.1 Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq_Hp85Ji5ahqSYGHPznqTsZqVBFpN4oM1k2zvkbtf37dFWD8C2gxNwIGt-SUBSNk-I4d2ndeBN9lbJOx2zaFhOZ-ObQEcrEMW1lOy4rr-oQyR8vk6SrWdWl-JNU1u7lEvdcfJiLXCflwmcVT_Umh8mp6q6att8j6FuGyhkuxZ9CF-M Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: c306d09e93584320b34697dba7641ac8 Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:40:31.311734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:40:31.313471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c306d09e93584320b34697dba7641ac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c306d09e93584320b34697dba7641ac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c306d09e93584320b34697dba7641ac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c306d09e93584320b34697dba7641ac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:40:31.313471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:40:31.313471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: c306d09e93584320b34697dba7641ac8 Sep 03 01:40:31.313471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:40:31.313471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-TestVolumeBootPattern-1645626888-project Sep 03 01:40:31.313471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:40:31.313471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:40:31.313471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: df0ffa9f450642cc94ed828cb34034b5 Sep 03 01:40:31.313471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-TestVolumeBootPattern-1645626888-project Sep 03 01:40:31.313471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:40:31.313471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:40:31.313471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '843467ed-5454-46d9-8626-619ff8f27fd9'} Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:40:31.314465 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:40:31.315968 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:40:31.318151 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9af3a564-9e2e-4c44-9ea2-7a4d3d37419e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Returning 404 to user: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:40:31.319271 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9af3a564-9e2e-4c44-9ea2-7a4d3d37419e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 404 len: 111 microversion: 2.1 time: 0.042198 Sep 03 01:40:31.329319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 560/1089] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:31 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:40:31.452137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-373756208", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-467180834", "security_groups": [{"name": "tempest-secgroup-smoke-1200131279"}], "block_device_mapping_v2": [{"uuid": "e1b787cf-08c4-4e59-82a2-c23323538ab6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "acc3f9d7-e89e-4ae5-bc90-4373dd60425f"}]}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:40:31.682004 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.network.neutron [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] validate_networks() for [('acc3f9d7-e89e-4ae5-bc90-4373dd60425f', None, None, None, None, None)] {{(pid=127553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:40:31.690105 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-6ba7b553-7c1c-4e37-ba30-7665794be9da tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:31.690879 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-6ba7b553-7c1c-4e37-ba30-7665794be9da tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:31.698410 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6ba7b553-7c1c-4e37-ba30-7665794be9da tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:31.699268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6ba7b553-7c1c-4e37-ba30-7665794be9da tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:31.699947 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6ba7b553-7c1c-4e37-ba30-7665794be9da tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:31.700876 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6ba7b553-7c1c-4e37-ba30-7665794be9da tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:31.701546 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6ba7b553-7c1c-4e37-ba30-7665794be9da tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:31.702313 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-6ba7b553-7c1c-4e37-ba30-7665794be9da tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:31.890017 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6ba7b553-7c1c-4e37-ba30-7665794be9da tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:31.901659 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6ba7b553-7c1c-4e37-ba30-7665794be9da tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:31.903548 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-6ba7b553-7c1c-4e37-ba30-7665794be9da tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:31.905076 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-6ba7b553-7c1c-4e37-ba30-7665794be9da tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.228055 Sep 03 01:40:31.906175 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 561/1090] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:31 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:32.255204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Flavor limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:40:32.255830 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Image limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:40:32.256491 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Flavor pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:40:32.262600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Image pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:40:32.263289 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:40:32.276974 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:32.277917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:32.278558 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:32.280138 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:32.280796 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:32.281553 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:32.305657 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Getting quotas for project c306d09e93584320b34697dba7641ac8. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:40:32.310177 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Getting quotas for user df0ffa9f450642cc94ed828cb34034b5 and project c306d09e93584320b34697dba7641ac8. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:40:32.390243 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Going to run 1 instances... {{(pid=127553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:40:32.392917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e1b787cf-08c4-4e59-82a2-c23323538ab6',volume_size=None,volume_type=None)] {{(pid=127553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:40:32.907314 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c3e07c48-fcda-4af5-9f4c-bfc03a8cf2e7 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.459290 Sep 03 01:40:32.908104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 530/1091] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:40:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:40:32.920285 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-1955c621-78fe-4b56-9bec-53f4575d887b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:32.921606 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-1955c621-78fe-4b56-9bec-53f4575d887b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:32.937703 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8671c7ab-ac5b-4a69-baa9-5696af5a2a51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:32.938675 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8671c7ab-ac5b-4a69-baa9-5696af5a2a51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:32.951268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8671c7ab-ac5b-4a69-baa9-5696af5a2a51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:32.956908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8671c7ab-ac5b-4a69-baa9-5696af5a2a51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:32.956908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8671c7ab-ac5b-4a69-baa9-5696af5a2a51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:32.956908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8671c7ab-ac5b-4a69-baa9-5696af5a2a51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:32.956908 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8671c7ab-ac5b-4a69-baa9-5696af5a2a51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:32.957681 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8671c7ab-ac5b-4a69-baa9-5696af5a2a51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:33.020355 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1955c621-78fe-4b56-9bec-53f4575d887b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:33.028950 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-1955c621-78fe-4b56-9bec-53f4575d887b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1093 microversion: 2.1 time: 0.112732 Sep 03 01:40:33.042363 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 562/1092] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:32 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1093 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:33.153084 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8671c7ab-ac5b-4a69-baa9-5696af5a2a51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:33.166688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:33.177406 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8671c7ab-ac5b-4a69-baa9-5696af5a2a51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:33.182645 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-8671c7ab-ac5b-4a69-baa9-5696af5a2a51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:33.185224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8671c7ab-ac5b-4a69-baa9-5696af5a2a51 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.253558 Sep 03 01:40:33.186369 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 531/1093] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:32 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:34.054776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f36078c0-835e-41f2-ae37-97790f0e5f36 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:34.056061 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f36078c0-835e-41f2-ae37-97790f0e5f36 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:34.063836 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f36078c0-835e-41f2-ae37-97790f0e5f36 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:34.064463 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f36078c0-835e-41f2-ae37-97790f0e5f36 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:34.064966 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f36078c0-835e-41f2-ae37-97790f0e5f36 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:34.065739 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f36078c0-835e-41f2-ae37-97790f0e5f36 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:34.066262 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f36078c0-835e-41f2-ae37-97790f0e5f36 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:34.066788 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f36078c0-835e-41f2-ae37-97790f0e5f36 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:34.134589 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f36078c0-835e-41f2-ae37-97790f0e5f36 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:34.143474 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f36078c0-835e-41f2-ae37-97790f0e5f36 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1143 microversion: 2.1 time: 0.093852 Sep 03 01:40:34.152157 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 563/1094] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:34 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1143 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:40:34.215282 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1aba316c-e63b-4b1c-ba14-2559a7ebaf0d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:34.215895 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1aba316c-e63b-4b1c-ba14-2559a7ebaf0d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:34.234877 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1aba316c-e63b-4b1c-ba14-2559a7ebaf0d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:34.235592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1aba316c-e63b-4b1c-ba14-2559a7ebaf0d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:34.236128 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1aba316c-e63b-4b1c-ba14-2559a7ebaf0d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:34.237653 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1aba316c-e63b-4b1c-ba14-2559a7ebaf0d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:34.238207 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1aba316c-e63b-4b1c-ba14-2559a7ebaf0d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:34.238831 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1aba316c-e63b-4b1c-ba14-2559a7ebaf0d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:34.479771 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1aba316c-e63b-4b1c-ba14-2559a7ebaf0d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:34.494248 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1aba316c-e63b-4b1c-ba14-2559a7ebaf0d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:34.494248 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1aba316c-e63b-4b1c-ba14-2559a7ebaf0d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:34.503557 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1aba316c-e63b-4b1c-ba14-2559a7ebaf0d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.288021 Sep 03 01:40:34.504900 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 532/1095] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:34 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:35.168448 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8a545c2a-de21-4557-8318-c0beee8b3552 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:35.169787 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-8a545c2a-de21-4557-8318-c0beee8b3552 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:35.177483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8a545c2a-de21-4557-8318-c0beee8b3552 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:35.178040 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8a545c2a-de21-4557-8318-c0beee8b3552 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:35.178512 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8a545c2a-de21-4557-8318-c0beee8b3552 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:35.179314 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8a545c2a-de21-4557-8318-c0beee8b3552 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:35.179975 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8a545c2a-de21-4557-8318-c0beee8b3552 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:35.180428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8a545c2a-de21-4557-8318-c0beee8b3552 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:35.251025 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8a545c2a-de21-4557-8318-c0beee8b3552 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:35.259221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-8a545c2a-de21-4557-8318-c0beee8b3552 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1143 microversion: 2.1 time: 0.094593 Sep 03 01:40:35.259806 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 564/1096] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:35 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1143 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:35.531979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-dc7079b5-ebe0-4433-99de-0809f4f47b9e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:35.532664 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-dc7079b5-ebe0-4433-99de-0809f4f47b9e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:35.543612 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dc7079b5-ebe0-4433-99de-0809f4f47b9e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:35.544112 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dc7079b5-ebe0-4433-99de-0809f4f47b9e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:35.544540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dc7079b5-ebe0-4433-99de-0809f4f47b9e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:35.545236 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dc7079b5-ebe0-4433-99de-0809f4f47b9e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:35.545730 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dc7079b5-ebe0-4433-99de-0809f4f47b9e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:35.546149 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dc7079b5-ebe0-4433-99de-0809f4f47b9e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:35.717464 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-dc7079b5-ebe0-4433-99de-0809f4f47b9e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:35.726839 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-dc7079b5-ebe0-4433-99de-0809f4f47b9e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:35.728298 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-dc7079b5-ebe0-4433-99de-0809f4f47b9e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:35.729538 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-dc7079b5-ebe0-4433-99de-0809f4f47b9e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.201455 Sep 03 01:40:35.730434 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 533/1097] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:35 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:36.282223 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e0f6b97c-9a12-49e3-b9ec-b0d0ef1bed7f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:36.284660 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e0f6b97c-9a12-49e3-b9ec-b0d0ef1bed7f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:36.292592 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0f6b97c-9a12-49e3-b9ec-b0d0ef1bed7f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:36.293525 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0f6b97c-9a12-49e3-b9ec-b0d0ef1bed7f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:36.294621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0f6b97c-9a12-49e3-b9ec-b0d0ef1bed7f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:36.295868 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0f6b97c-9a12-49e3-b9ec-b0d0ef1bed7f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:36.296559 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0f6b97c-9a12-49e3-b9ec-b0d0ef1bed7f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:36.297470 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e0f6b97c-9a12-49e3-b9ec-b0d0ef1bed7f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:36.301195 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:36.388659 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e0f6b97c-9a12-49e3-b9ec-b0d0ef1bed7f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:36.398637 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e0f6b97c-9a12-49e3-b9ec-b0d0ef1bed7f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1143 microversion: 2.1 time: 0.120134 Sep 03 01:40:36.399692 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 565/1098] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:36 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1143 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:36.757247 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1edbb7e9-365a-4eaa-af0f-b31fb839ca8a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:36.758370 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-1edbb7e9-365a-4eaa-af0f-b31fb839ca8a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:36.767085 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1edbb7e9-365a-4eaa-af0f-b31fb839ca8a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:36.767700 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1edbb7e9-365a-4eaa-af0f-b31fb839ca8a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:36.768274 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1edbb7e9-365a-4eaa-af0f-b31fb839ca8a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:36.769056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1edbb7e9-365a-4eaa-af0f-b31fb839ca8a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:36.769620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1edbb7e9-365a-4eaa-af0f-b31fb839ca8a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:36.770146 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-1edbb7e9-365a-4eaa-af0f-b31fb839ca8a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:36.969084 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1edbb7e9-365a-4eaa-af0f-b31fb839ca8a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:36.984237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1edbb7e9-365a-4eaa-af0f-b31fb839ca8a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:36.985686 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-1edbb7e9-365a-4eaa-af0f-b31fb839ca8a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:36.986916 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1edbb7e9-365a-4eaa-af0f-b31fb839ca8a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.235721 Sep 03 01:40:36.987776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 534/1099] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:36 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:37.424559 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-bda863fb-bb55-491d-b9b1-88fd3332ca6a tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:37.429466 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-bda863fb-bb55-491d-b9b1-88fd3332ca6a tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:37.438572 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bda863fb-bb55-491d-b9b1-88fd3332ca6a tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:37.439298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bda863fb-bb55-491d-b9b1-88fd3332ca6a tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:37.439997 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bda863fb-bb55-491d-b9b1-88fd3332ca6a tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:37.440980 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bda863fb-bb55-491d-b9b1-88fd3332ca6a tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:37.441637 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bda863fb-bb55-491d-b9b1-88fd3332ca6a tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:37.442292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bda863fb-bb55-491d-b9b1-88fd3332ca6a tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:37.528716 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bda863fb-bb55-491d-b9b1-88fd3332ca6a tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:37.538720 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-bda863fb-bb55-491d-b9b1-88fd3332ca6a tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1143 microversion: 2.1 time: 0.117679 Sep 03 01:40:37.539717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 566/1100] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:37 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1143 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:38.015456 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e876d932-f1ef-4275-8c3c-43a1180477ea tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:38.016281 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e876d932-f1ef-4275-8c3c-43a1180477ea tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:38.028092 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e876d932-f1ef-4275-8c3c-43a1180477ea tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:38.029232 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e876d932-f1ef-4275-8c3c-43a1180477ea tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:38.030018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e876d932-f1ef-4275-8c3c-43a1180477ea tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:38.031484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e876d932-f1ef-4275-8c3c-43a1180477ea tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:38.032597 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e876d932-f1ef-4275-8c3c-43a1180477ea tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:38.033353 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e876d932-f1ef-4275-8c3c-43a1180477ea tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:38.205646 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e876d932-f1ef-4275-8c3c-43a1180477ea tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:38.214892 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e876d932-f1ef-4275-8c3c-43a1180477ea tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:38.216781 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e876d932-f1ef-4275-8c3c-43a1180477ea tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:38.218259 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e876d932-f1ef-4275-8c3c-43a1180477ea tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.207973 Sep 03 01:40:38.218856 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 535/1101] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:38 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:40:38.567375 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-fe49ac3e-8db5-4dbe-a72f-9832a22159c3 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:38.568126 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-fe49ac3e-8db5-4dbe-a72f-9832a22159c3 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:38.575997 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe49ac3e-8db5-4dbe-a72f-9832a22159c3 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:38.576641 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe49ac3e-8db5-4dbe-a72f-9832a22159c3 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:38.577274 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe49ac3e-8db5-4dbe-a72f-9832a22159c3 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:38.578885 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe49ac3e-8db5-4dbe-a72f-9832a22159c3 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:38.579511 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe49ac3e-8db5-4dbe-a72f-9832a22159c3 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:38.580098 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fe49ac3e-8db5-4dbe-a72f-9832a22159c3 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:38.649259 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-fe49ac3e-8db5-4dbe-a72f-9832a22159c3 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:38.663111 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-fe49ac3e-8db5-4dbe-a72f-9832a22159c3 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1143 microversion: 2.1 time: 0.100256 Sep 03 01:40:38.664316 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 567/1102] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:38 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1143 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:39.247359 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5d95b3d9-7236-4340-882e-a96f14ced36d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:39.247961 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-5d95b3d9-7236-4340-882e-a96f14ced36d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:39.254228 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d95b3d9-7236-4340-882e-a96f14ced36d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:39.256626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d95b3d9-7236-4340-882e-a96f14ced36d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:39.256626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d95b3d9-7236-4340-882e-a96f14ced36d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:39.256626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d95b3d9-7236-4340-882e-a96f14ced36d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:39.256626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d95b3d9-7236-4340-882e-a96f14ced36d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:39.256978 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-5d95b3d9-7236-4340-882e-a96f14ced36d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:39.395497 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5d95b3d9-7236-4340-882e-a96f14ced36d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:39.404208 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5d95b3d9-7236-4340-882e-a96f14ced36d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:39.405729 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-5d95b3d9-7236-4340-882e-a96f14ced36d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:39.406919 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5d95b3d9-7236-4340-882e-a96f14ced36d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.164132 Sep 03 01:40:39.411377 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 536/1103] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:39 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:40:39.686531 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-60dd7e24-2163-42e1-83dc-e5f71b7173f0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:39.687133 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-60dd7e24-2163-42e1-83dc-e5f71b7173f0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:39.693429 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-60dd7e24-2163-42e1-83dc-e5f71b7173f0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:39.693917 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-60dd7e24-2163-42e1-83dc-e5f71b7173f0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:39.694359 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-60dd7e24-2163-42e1-83dc-e5f71b7173f0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:39.695058 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-60dd7e24-2163-42e1-83dc-e5f71b7173f0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:39.695504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-60dd7e24-2163-42e1-83dc-e5f71b7173f0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:39.695920 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-60dd7e24-2163-42e1-83dc-e5f71b7173f0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:39.762175 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-60dd7e24-2163-42e1-83dc-e5f71b7173f0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:39.769986 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-60dd7e24-2163-42e1-83dc-e5f71b7173f0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1143 microversion: 2.1 time: 0.087365 Sep 03 01:40:39.770692 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 568/1104] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:39 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1143 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:40.433017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2c106c69-ebae-435b-9758-0330b4253d41 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:40.433624 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2c106c69-ebae-435b-9758-0330b4253d41 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:40.440875 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c106c69-ebae-435b-9758-0330b4253d41 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:40.441600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c106c69-ebae-435b-9758-0330b4253d41 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:40.442035 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c106c69-ebae-435b-9758-0330b4253d41 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:40.442766 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c106c69-ebae-435b-9758-0330b4253d41 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:40.443213 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c106c69-ebae-435b-9758-0330b4253d41 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:40.447870 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2c106c69-ebae-435b-9758-0330b4253d41 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:40.580637 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2c106c69-ebae-435b-9758-0330b4253d41 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:40.595416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2c106c69-ebae-435b-9758-0330b4253d41 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:40.595416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2c106c69-ebae-435b-9758-0330b4253d41 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:40.595416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2c106c69-ebae-435b-9758-0330b4253d41 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.163766 Sep 03 01:40:40.595755 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 537/1105] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:40 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:40.793181 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ade08155-4097-463e-bb6e-07b057bdc756 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:40.794087 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ade08155-4097-463e-bb6e-07b057bdc756 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:40.800842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ade08155-4097-463e-bb6e-07b057bdc756 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:40.804893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ade08155-4097-463e-bb6e-07b057bdc756 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:40.804893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ade08155-4097-463e-bb6e-07b057bdc756 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:40.804893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ade08155-4097-463e-bb6e-07b057bdc756 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:40.804893 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ade08155-4097-463e-bb6e-07b057bdc756 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:40.806411 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ade08155-4097-463e-bb6e-07b057bdc756 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:40.865214 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ade08155-4097-463e-bb6e-07b057bdc756 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:40.873870 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ade08155-4097-463e-bb6e-07b057bdc756 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1191 microversion: 2.1 time: 0.084842 Sep 03 01:40:40.874487 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 569/1106] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:40 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:41.030513 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-00db3495-cdef-4384-9a4c-08a899c5885f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:41.031040 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-00db3495-cdef-4384-9a4c-08a899c5885f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:41.037871 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-00db3495-cdef-4384-9a4c-08a899c5885f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:41.038627 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-00db3495-cdef-4384-9a4c-08a899c5885f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:41.039064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-00db3495-cdef-4384-9a4c-08a899c5885f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:41.040509 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-00db3495-cdef-4384-9a4c-08a899c5885f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:41.040958 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-00db3495-cdef-4384-9a4c-08a899c5885f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:41.041375 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-00db3495-cdef-4384-9a4c-08a899c5885f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:41.064783 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-00db3495-cdef-4384-9a4c-08a899c5885f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc/ips" status: 200 len: 148 microversion: 2.1 time: 0.038281 Sep 03 01:40:41.065359 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 538/1107] 10.222.0.13 () {58 vars in 1248 bytes} [Sat Sep 3 01:40:41 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc/ips => generated 148 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:40:41.618621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cd5fac62-c35c-4f0c-8f43-1e6c50835e89 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:41.619443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cd5fac62-c35c-4f0c-8f43-1e6c50835e89 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:41.626186 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd5fac62-c35c-4f0c-8f43-1e6c50835e89 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:41.626898 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd5fac62-c35c-4f0c-8f43-1e6c50835e89 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:41.627632 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd5fac62-c35c-4f0c-8f43-1e6c50835e89 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:41.628479 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd5fac62-c35c-4f0c-8f43-1e6c50835e89 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:41.629084 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd5fac62-c35c-4f0c-8f43-1e6c50835e89 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:41.629677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd5fac62-c35c-4f0c-8f43-1e6c50835e89 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:41.883131 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cd5fac62-c35c-4f0c-8f43-1e6c50835e89 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:41.901964 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cd5fac62-c35c-4f0c-8f43-1e6c50835e89 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:41.905367 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-48eae1f7-efa1-45fe-86de-6f7da6216f2c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:41.905367 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-48eae1f7-efa1-45fe-86de-6f7da6216f2c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:41.905959 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cd5fac62-c35c-4f0c-8f43-1e6c50835e89 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:41.905959 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cd5fac62-c35c-4f0c-8f43-1e6c50835e89 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.290578 Sep 03 01:40:41.906872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 570/1108] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:41 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:41.911512 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-48eae1f7-efa1-45fe-86de-6f7da6216f2c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:41.912255 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-48eae1f7-efa1-45fe-86de-6f7da6216f2c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:41.912911 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-48eae1f7-efa1-45fe-86de-6f7da6216f2c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:41.913827 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-48eae1f7-efa1-45fe-86de-6f7da6216f2c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:41.914564 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-48eae1f7-efa1-45fe-86de-6f7da6216f2c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:41.915984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-48eae1f7-efa1-45fe-86de-6f7da6216f2c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:42.000294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-48eae1f7-efa1-45fe-86de-6f7da6216f2c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:42.008209 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-48eae1f7-efa1-45fe-86de-6f7da6216f2c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1209 microversion: 2.1 time: 0.110672 Sep 03 01:40:42.009775 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 539/1109] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:41 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1209 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:40:42.931494 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b6993aa0-5bd9-43e4-b7e3-c8fb1ddf8124 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:42.932063 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b6993aa0-5bd9-43e4-b7e3-c8fb1ddf8124 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:42.938533 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6993aa0-5bd9-43e4-b7e3-c8fb1ddf8124 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:42.939037 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6993aa0-5bd9-43e4-b7e3-c8fb1ddf8124 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:42.939473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6993aa0-5bd9-43e4-b7e3-c8fb1ddf8124 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:42.940184 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6993aa0-5bd9-43e4-b7e3-c8fb1ddf8124 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:42.940642 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6993aa0-5bd9-43e4-b7e3-c8fb1ddf8124 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:42.941113 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b6993aa0-5bd9-43e4-b7e3-c8fb1ddf8124 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:43.025120 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:43.032459 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d2813e6c-0a9a-4dfe-8e11-c2871d8374e6 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:43.033071 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d2813e6c-0a9a-4dfe-8e11-c2871d8374e6 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:43.035288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:43.035952 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=6 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:43.042074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d2813e6c-0a9a-4dfe-8e11-c2871d8374e6 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:43.042595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d2813e6c-0a9a-4dfe-8e11-c2871d8374e6 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:43.043052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d2813e6c-0a9a-4dfe-8e11-c2871d8374e6 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:43.043743 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d2813e6c-0a9a-4dfe-8e11-c2871d8374e6 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:43.044195 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d2813e6c-0a9a-4dfe-8e11-c2871d8374e6 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:43.044612 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d2813e6c-0a9a-4dfe-8e11-c2871d8374e6 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:43.087433 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b6993aa0-5bd9-43e4-b7e3-c8fb1ddf8124 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:43.095677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b6993aa0-5bd9-43e4-b7e3-c8fb1ddf8124 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:43.097131 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b6993aa0-5bd9-43e4-b7e3-c8fb1ddf8124 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:43.098303 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b6993aa0-5bd9-43e4-b7e3-c8fb1ddf8124 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.171358 Sep 03 01:40:43.098904 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 571/1110] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:42 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:43.177250 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d2813e6c-0a9a-4dfe-8e11-c2871d8374e6 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:43.186172 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d2813e6c-0a9a-4dfe-8e11-c2871d8374e6 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1277 microversion: 2.1 time: 0.157548 Sep 03 01:40:43.186771 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 540/1111] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:43 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:40:43.763311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9578a674-d204-4e4c-b3a7-3fbc6bc220fd tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d8460ed-204c-44f9-ac70-ae69807488a7"}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:40:43.763311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9578a674-d204-4e4c-b3a7-3fbc6bc220fd tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:43.766939 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9578a674-d204-4e4c-b3a7-3fbc6bc220fd tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:43.766939 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9578a674-d204-4e4c-b3a7-3fbc6bc220fd tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:43.766939 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9578a674-d204-4e4c-b3a7-3fbc6bc220fd tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:43.767353 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9578a674-d204-4e4c-b3a7-3fbc6bc220fd tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:43.767818 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9578a674-d204-4e4c-b3a7-3fbc6bc220fd tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:43.769492 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9578a674-d204-4e4c-b3a7-3fbc6bc220fd tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:43.915721 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-c0ea0cec-337e-42f1-a4bd-fdf539f98d3e req-f195688d-75dd-4494-aab0-c9b0b64934bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e156f97d-5465-4597-a836-c70692edfd41", "name": "network-vif-plugged", "status": "completed", "tag": "b4585caf-c260-4618-ba71-326b4c35ffdf"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:40:43.940591 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-c0ea0cec-337e-42f1-a4bd-fdf539f98d3e req-f195688d-75dd-4494-aab0-c9b0b64934bb service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:43.940591 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-c0ea0cec-337e-42f1-a4bd-fdf539f98d3e req-f195688d-75dd-4494-aab0-c9b0b64934bb service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:43.940591 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-c0ea0cec-337e-42f1-a4bd-fdf539f98d3e req-f195688d-75dd-4494-aab0-c9b0b64934bb service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:43.943842 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-c0ea0cec-337e-42f1-a4bd-fdf539f98d3e req-f195688d-75dd-4494-aab0-c9b0b64934bb service nova] Creating event network-vif-plugged:b4585caf-c260-4618-ba71-326b4c35ffdf for instance e156f97d-5465-4597-a836-c70692edfd41 on hv-cinder-83800 Sep 03 01:40:43.948986 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-c0ea0cec-337e-42f1-a4bd-fdf539f98d3e req-f195688d-75dd-4494-aab0-c9b0b64934bb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039566 Sep 03 01:40:43.949589 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 541/1112] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:40:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:40:44.125804 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ab386a4e-a0b0-4a9a-97c1-b16f6fb4e84a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:44.126528 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ab386a4e-a0b0-4a9a-97c1-b16f6fb4e84a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:44.134245 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ab386a4e-a0b0-4a9a-97c1-b16f6fb4e84a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:44.134768 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ab386a4e-a0b0-4a9a-97c1-b16f6fb4e84a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:44.135203 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ab386a4e-a0b0-4a9a-97c1-b16f6fb4e84a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:44.135892 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ab386a4e-a0b0-4a9a-97c1-b16f6fb4e84a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:44.136342 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ab386a4e-a0b0-4a9a-97c1-b16f6fb4e84a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:44.136814 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ab386a4e-a0b0-4a9a-97c1-b16f6fb4e84a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:44.309862 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ab386a4e-a0b0-4a9a-97c1-b16f6fb4e84a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:44.318986 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ab386a4e-a0b0-4a9a-97c1-b16f6fb4e84a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:44.323321 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ab386a4e-a0b0-4a9a-97c1-b16f6fb4e84a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:44.324534 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ab386a4e-a0b0-4a9a-97c1-b16f6fb4e84a tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.203534 Sep 03 01:40:44.328873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 542/1113] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:44 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:40:44.335739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-3f9fbbfd-521a-4f58-8912-34b6a659af60 req-81a2f313-f53c-483f-8eb6-5156ca52cb1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76830239-8685-42c5-98e6-e5fd654d77d7", "tag": "9ea8f48a-f00d-4263-8d2c-f16a754b34e4"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:40:44.345939 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-3f9fbbfd-521a-4f58-8912-34b6a659af60 req-81a2f313-f53c-483f-8eb6-5156ca52cb1c service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:44.346707 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-3f9fbbfd-521a-4f58-8912-34b6a659af60 req-81a2f313-f53c-483f-8eb6-5156ca52cb1c service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:44.347334 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-3f9fbbfd-521a-4f58-8912-34b6a659af60 req-81a2f313-f53c-483f-8eb6-5156ca52cb1c service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:44.359823 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-3f9fbbfd-521a-4f58-8912-34b6a659af60 req-81a2f313-f53c-483f-8eb6-5156ca52cb1c service nova] Creating event network-changed:9ea8f48a-f00d-4263-8d2c-f16a754b34e4 for instance 76830239-8685-42c5-98e6-e5fd654d77d7 on hv-cinder-83800 Sep 03 01:40:44.365858 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-3f9fbbfd-521a-4f58-8912-34b6a659af60 req-81a2f313-f53c-483f-8eb6-5156ca52cb1c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035269 Sep 03 01:40:44.367115 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 543/1114] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:40:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:40:44.373842 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-debdca52-d45e-46f7-a3b5-bc09a20b58bd tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:44.374760 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-debdca52-d45e-46f7-a3b5-bc09a20b58bd tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:44.381183 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-debdca52-d45e-46f7-a3b5-bc09a20b58bd tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:44.381674 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-debdca52-d45e-46f7-a3b5-bc09a20b58bd tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:44.382248 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-debdca52-d45e-46f7-a3b5-bc09a20b58bd tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:44.383177 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-debdca52-d45e-46f7-a3b5-bc09a20b58bd tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:44.384553 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-debdca52-d45e-46f7-a3b5-bc09a20b58bd tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:44.385154 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-debdca52-d45e-46f7-a3b5-bc09a20b58bd tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:44.568862 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-debdca52-d45e-46f7-a3b5-bc09a20b58bd tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:44.577788 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-debdca52-d45e-46f7-a3b5-bc09a20b58bd tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1265 microversion: 2.1 time: 0.208155 Sep 03 01:40:44.578943 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 544/1115] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:44 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1265 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:44.737216 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9578a674-d204-4e4c-b3a7-3fbc6bc220fd tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "POST /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.985016 Sep 03 01:40:44.743819 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 572/1116] 10.222.0.13 () {60 vars in 1323 bytes} [Sat Sep 3 01:40:43 2022] POST /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc/os-volume_attachments => generated 194 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:40:45.351929 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e0a7ddfb-9207-4979-8656-89ede45166fb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:45.352547 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e0a7ddfb-9207-4979-8656-89ede45166fb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:45.358779 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0a7ddfb-9207-4979-8656-89ede45166fb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:45.359268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0a7ddfb-9207-4979-8656-89ede45166fb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:45.359704 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0a7ddfb-9207-4979-8656-89ede45166fb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:45.360404 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0a7ddfb-9207-4979-8656-89ede45166fb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:45.360857 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0a7ddfb-9207-4979-8656-89ede45166fb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:45.361280 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e0a7ddfb-9207-4979-8656-89ede45166fb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:45.497144 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e0a7ddfb-9207-4979-8656-89ede45166fb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:45.505483 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e0a7ddfb-9207-4979-8656-89ede45166fb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:45.507006 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e0a7ddfb-9207-4979-8656-89ede45166fb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:45.509792 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e0a7ddfb-9207-4979-8656-89ede45166fb tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.160396 Sep 03 01:40:45.509792 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 545/1117] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:45 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:45.607397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-53f98496-2250-451c-afc4-fc3c8fc61272 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:45.608083 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-53f98496-2250-451c-afc4-fc3c8fc61272 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:45.618781 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-53f98496-2250-451c-afc4-fc3c8fc61272 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:45.619672 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-53f98496-2250-451c-afc4-fc3c8fc61272 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:45.620221 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-53f98496-2250-451c-afc4-fc3c8fc61272 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:45.621069 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-53f98496-2250-451c-afc4-fc3c8fc61272 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:45.621603 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-53f98496-2250-451c-afc4-fc3c8fc61272 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:45.622202 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-53f98496-2250-451c-afc4-fc3c8fc61272 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:45.767698 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-53f98496-2250-451c-afc4-fc3c8fc61272 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:45.775981 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-53f98496-2250-451c-afc4-fc3c8fc61272 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1265 microversion: 2.1 time: 0.174998 Sep 03 01:40:45.776552 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 573/1118] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:45 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:46.535018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bd37f90a-b879-4344-8eeb-f951867d9210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:46.536207 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bd37f90a-b879-4344-8eeb-f951867d9210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:46.542091 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd37f90a-b879-4344-8eeb-f951867d9210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:46.542637 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd37f90a-b879-4344-8eeb-f951867d9210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:46.543075 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd37f90a-b879-4344-8eeb-f951867d9210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:46.543760 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd37f90a-b879-4344-8eeb-f951867d9210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:46.544212 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd37f90a-b879-4344-8eeb-f951867d9210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:46.544638 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bd37f90a-b879-4344-8eeb-f951867d9210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:46.674082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bd37f90a-b879-4344-8eeb-f951867d9210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:46.683032 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bd37f90a-b879-4344-8eeb-f951867d9210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:46.684464 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bd37f90a-b879-4344-8eeb-f951867d9210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:46.685690 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bd37f90a-b879-4344-8eeb-f951867d9210 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1730 microversion: 2.20 time: 0.154747 Sep 03 01:40:46.686291 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 546/1119] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:46 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:40:46.799614 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-662e93b5-23c2-4324-bc6a-1cf040c9aa77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:46.800292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-662e93b5-23c2-4324-bc6a-1cf040c9aa77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:46.807260 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-662e93b5-23c2-4324-bc6a-1cf040c9aa77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:46.807772 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-662e93b5-23c2-4324-bc6a-1cf040c9aa77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:46.808204 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-662e93b5-23c2-4324-bc6a-1cf040c9aa77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:46.808891 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-662e93b5-23c2-4324-bc6a-1cf040c9aa77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:46.809344 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-662e93b5-23c2-4324-bc6a-1cf040c9aa77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:46.809763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-662e93b5-23c2-4324-bc6a-1cf040c9aa77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:46.948103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-662e93b5-23c2-4324-bc6a-1cf040c9aa77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:46.955854 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-662e93b5-23c2-4324-bc6a-1cf040c9aa77 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1265 microversion: 2.1 time: 0.160067 Sep 03 01:40:46.956466 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 574/1120] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:46 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:47.712331 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-814e9544-6c27-4c57-9d2c-6c078dc1e930 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:47.713024 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-814e9544-6c27-4c57-9d2c-6c078dc1e930 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:47.719538 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-814e9544-6c27-4c57-9d2c-6c078dc1e930 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:47.720031 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-814e9544-6c27-4c57-9d2c-6c078dc1e930 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:47.720467 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-814e9544-6c27-4c57-9d2c-6c078dc1e930 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:47.721172 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-814e9544-6c27-4c57-9d2c-6c078dc1e930 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:47.721626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-814e9544-6c27-4c57-9d2c-6c078dc1e930 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:47.722052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-814e9544-6c27-4c57-9d2c-6c078dc1e930 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:47.863349 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-814e9544-6c27-4c57-9d2c-6c078dc1e930 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:47.872252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-814e9544-6c27-4c57-9d2c-6c078dc1e930 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:47.873822 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-814e9544-6c27-4c57-9d2c-6c078dc1e930 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:47.875112 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-814e9544-6c27-4c57-9d2c-6c078dc1e930 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1717 microversion: 2.20 time: 0.167360 Sep 03 01:40:47.875674 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 547/1121] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:40:47 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1717 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 03 01:40:47.978812 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-bd64d37f-ab9f-4d95-9cf0-3b737635f984 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:47.979564 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-bd64d37f-ab9f-4d95-9cf0-3b737635f984 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:47.985757 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bd64d37f-ab9f-4d95-9cf0-3b737635f984 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:47.986236 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bd64d37f-ab9f-4d95-9cf0-3b737635f984 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:47.986699 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bd64d37f-ab9f-4d95-9cf0-3b737635f984 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:47.987384 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bd64d37f-ab9f-4d95-9cf0-3b737635f984 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:47.987850 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bd64d37f-ab9f-4d95-9cf0-3b737635f984 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:47.988248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bd64d37f-ab9f-4d95-9cf0-3b737635f984 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:48.121236 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bd64d37f-ab9f-4d95-9cf0-3b737635f984 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:48.129084 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-bd64d37f-ab9f-4d95-9cf0-3b737635f984 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1265 microversion: 2.1 time: 0.154140 Sep 03 01:40:48.129649 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 575/1122] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:47 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:49.156305 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b809bd68-bed8-4e31-a298-4f8d62e0a816 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:49.156993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b809bd68-bed8-4e31-a298-4f8d62e0a816 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:49.163717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b809bd68-bed8-4e31-a298-4f8d62e0a816 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:49.164201 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b809bd68-bed8-4e31-a298-4f8d62e0a816 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:49.164717 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b809bd68-bed8-4e31-a298-4f8d62e0a816 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:49.165658 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b809bd68-bed8-4e31-a298-4f8d62e0a816 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:49.166110 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b809bd68-bed8-4e31-a298-4f8d62e0a816 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:49.166565 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b809bd68-bed8-4e31-a298-4f8d62e0a816 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:49.297222 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b809bd68-bed8-4e31-a298-4f8d62e0a816 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:49.304843 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b809bd68-bed8-4e31-a298-4f8d62e0a816 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1265 microversion: 2.1 time: 0.152627 Sep 03 01:40:49.305424 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 548/1123] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:49 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:50.327229 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5de33f70-b5bc-4301-b562-1b0c1370ab2e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:50.327885 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5de33f70-b5bc-4301-b562-1b0c1370ab2e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:50.334398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5de33f70-b5bc-4301-b562-1b0c1370ab2e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:50.339669 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5de33f70-b5bc-4301-b562-1b0c1370ab2e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:50.339669 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5de33f70-b5bc-4301-b562-1b0c1370ab2e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:50.339669 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5de33f70-b5bc-4301-b562-1b0c1370ab2e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:50.339669 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5de33f70-b5bc-4301-b562-1b0c1370ab2e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:50.340059 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5de33f70-b5bc-4301-b562-1b0c1370ab2e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:50.467555 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-5de33f70-b5bc-4301-b562-1b0c1370ab2e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:50.475168 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5de33f70-b5bc-4301-b562-1b0c1370ab2e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1265 microversion: 2.1 time: 0.151902 Sep 03 01:40:50.475737 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 576/1124] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:50 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:51.499011 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b9466db8-3d67-40fe-8743-b7da6500941c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:51.499690 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b9466db8-3d67-40fe-8743-b7da6500941c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:51.506030 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b9466db8-3d67-40fe-8743-b7da6500941c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:51.506548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b9466db8-3d67-40fe-8743-b7da6500941c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:51.506982 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b9466db8-3d67-40fe-8743-b7da6500941c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:51.507665 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b9466db8-3d67-40fe-8743-b7da6500941c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:51.508463 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b9466db8-3d67-40fe-8743-b7da6500941c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:51.508890 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b9466db8-3d67-40fe-8743-b7da6500941c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:51.639107 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b9466db8-3d67-40fe-8743-b7da6500941c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:51.646639 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b9466db8-3d67-40fe-8743-b7da6500941c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1265 microversion: 2.1 time: 0.151464 Sep 03 01:40:51.647201 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 549/1125] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:51 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:52.669740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e2f367a4-4162-4398-9671-5eb25841fef2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:52.670288 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e2f367a4-4162-4398-9671-5eb25841fef2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:52.676743 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e2f367a4-4162-4398-9671-5eb25841fef2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:52.677223 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e2f367a4-4162-4398-9671-5eb25841fef2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:52.677655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e2f367a4-4162-4398-9671-5eb25841fef2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:52.678360 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e2f367a4-4162-4398-9671-5eb25841fef2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:52.678956 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e2f367a4-4162-4398-9671-5eb25841fef2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:52.679382 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e2f367a4-4162-4398-9671-5eb25841fef2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:52.807882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e2f367a4-4162-4398-9671-5eb25841fef2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:52.815887 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e2f367a4-4162-4398-9671-5eb25841fef2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1265 microversion: 2.1 time: 0.150167 Sep 03 01:40:52.816444 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 577/1126] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:52 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:40:53.840242 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bfd2fd48-c0d1-4e0d-b7e4-713a4d71672c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:53.840921 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bfd2fd48-c0d1-4e0d-b7e4-713a4d71672c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:53.843416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:53.848025 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bfd2fd48-c0d1-4e0d-b7e4-713a4d71672c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:53.848513 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bfd2fd48-c0d1-4e0d-b7e4-713a4d71672c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:53.848960 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bfd2fd48-c0d1-4e0d-b7e4-713a4d71672c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:53.849657 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bfd2fd48-c0d1-4e0d-b7e4-713a4d71672c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:53.850114 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bfd2fd48-c0d1-4e0d-b7e4-713a4d71672c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:53.850575 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-bfd2fd48-c0d1-4e0d-b7e4-713a4d71672c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:53.854920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=100 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:53.987543 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bfd2fd48-c0d1-4e0d-b7e4-713a4d71672c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:53.996069 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bfd2fd48-c0d1-4e0d-b7e4-713a4d71672c tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1265 microversion: 2.1 time: 0.160671 Sep 03 01:40:53.996686 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 550/1127] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:53 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:54.645728 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8ed7d023-2462-4d6f-9868-fcc8de69aeeb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:54.646241 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-8ed7d023-2462-4d6f-9868-fcc8de69aeeb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:54.648722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:54.653477 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ed7d023-2462-4d6f-9868-fcc8de69aeeb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:54.653957 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ed7d023-2462-4d6f-9868-fcc8de69aeeb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:54.654420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ed7d023-2462-4d6f-9868-fcc8de69aeeb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:54.655148 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ed7d023-2462-4d6f-9868-fcc8de69aeeb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:54.655607 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ed7d023-2462-4d6f-9868-fcc8de69aeeb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:54.656029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ed7d023-2462-4d6f-9868-fcc8de69aeeb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:54.748373 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-8ed7d023-2462-4d6f-9868-fcc8de69aeeb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lazy-loading 'services' on Instance uuid 339527e0-bd33-4cfb-950f-ccb7a68a69bc {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:40:54.995351 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-8ed7d023-2462-4d6f-9868-fcc8de69aeeb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc/os-volume_attachments/3d8460ed-204c-44f9-ac70-ae69807488a7" status: 202 len: 0 microversion: 2.1 time: 0.353506 Sep 03 01:40:54.995927 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 578/1128] 10.222.0.13 () {58 vars in 1416 bytes} [Sat Sep 3 01:40:54 2022] DELETE /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc/os-volume_attachments/3d8460ed-204c-44f9-ac70-ae69807488a7 => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:40:55.004285 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e6cc9aa9-6fc6-4f30-bb47-907b9bafd0e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:55.006557 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e6cc9aa9-6fc6-4f30-bb47-907b9bafd0e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:55.014027 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e6cc9aa9-6fc6-4f30-bb47-907b9bafd0e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:55.014555 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e6cc9aa9-6fc6-4f30-bb47-907b9bafd0e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:55.015083 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e6cc9aa9-6fc6-4f30-bb47-907b9bafd0e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:55.016066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e6cc9aa9-6fc6-4f30-bb47-907b9bafd0e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:55.016559 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e6cc9aa9-6fc6-4f30-bb47-907b9bafd0e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:55.016981 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e6cc9aa9-6fc6-4f30-bb47-907b9bafd0e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:55.021935 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-1f29d72e-e6a0-4150-9ae1-9dc924adf0a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:55.021935 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-1f29d72e-e6a0-4150-9ae1-9dc924adf0a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:55.028367 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1f29d72e-e6a0-4150-9ae1-9dc924adf0a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:55.028849 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1f29d72e-e6a0-4150-9ae1-9dc924adf0a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:55.029282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1f29d72e-e6a0-4150-9ae1-9dc924adf0a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:55.029970 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1f29d72e-e6a0-4150-9ae1-9dc924adf0a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:55.030441 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1f29d72e-e6a0-4150-9ae1-9dc924adf0a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:55.030861 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1f29d72e-e6a0-4150-9ae1-9dc924adf0a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:55.048050 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e6cc9aa9-6fc6-4f30-bb47-907b9bafd0e7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047633 Sep 03 01:40:55.048640 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 551/1129] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:40:54 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:40:55.165765 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1f29d72e-e6a0-4150-9ae1-9dc924adf0a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:55.168042 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:40:55.174428 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-1f29d72e-e6a0-4150-9ae1-9dc924adf0a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1265 microversion: 2.1 time: 0.157678 Sep 03 01:40:55.174988 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 579/1130] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:55 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:40:56.060705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2b8e41e7-b259-4a43-a01b-c6c73ac40fc8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:56.062956 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2b8e41e7-b259-4a43-a01b-c6c73ac40fc8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:56.069266 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b8e41e7-b259-4a43-a01b-c6c73ac40fc8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:56.069746 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b8e41e7-b259-4a43-a01b-c6c73ac40fc8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:56.070180 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b8e41e7-b259-4a43-a01b-c6c73ac40fc8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:56.071415 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b8e41e7-b259-4a43-a01b-c6c73ac40fc8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:56.071907 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b8e41e7-b259-4a43-a01b-c6c73ac40fc8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:56.072374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b8e41e7-b259-4a43-a01b-c6c73ac40fc8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:56.101591 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2b8e41e7-b259-4a43-a01b-c6c73ac40fc8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044862 Sep 03 01:40:56.102178 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 552/1131] 10.222.0.13 () {58 vars in 1302 bytes} [Sat Sep 3 01:40:56 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 03 01:40:56.175240 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e640b1bc-3df8-42f2-813c-7ddbb4b1a571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:56.175811 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e640b1bc-3df8-42f2-813c-7ddbb4b1a571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:56.183470 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e640b1bc-3df8-42f2-813c-7ddbb4b1a571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:56.183946 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e640b1bc-3df8-42f2-813c-7ddbb4b1a571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:56.184377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e640b1bc-3df8-42f2-813c-7ddbb4b1a571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:56.185072 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e640b1bc-3df8-42f2-813c-7ddbb4b1a571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:56.185523 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e640b1bc-3df8-42f2-813c-7ddbb4b1a571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:56.185943 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e640b1bc-3df8-42f2-813c-7ddbb4b1a571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:56.197675 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-be149bea-8cda-4286-ba5f-37163a40c8e2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:56.198237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-be149bea-8cda-4286-ba5f-37163a40c8e2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:56.205550 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-be149bea-8cda-4286-ba5f-37163a40c8e2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:56.206039 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-be149bea-8cda-4286-ba5f-37163a40c8e2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:56.206503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-be149bea-8cda-4286-ba5f-37163a40c8e2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:56.207380 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-be149bea-8cda-4286-ba5f-37163a40c8e2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:56.207991 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-be149bea-8cda-4286-ba5f-37163a40c8e2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:56.208566 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-be149bea-8cda-4286-ba5f-37163a40c8e2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:56.221450 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e640b1bc-3df8-42f2-813c-7ddbb4b1a571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Going to try to terminate instance {{(pid=127552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:40:56.348710 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-be149bea-8cda-4286-ba5f-37163a40c8e2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:56.359607 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-be149bea-8cda-4286-ba5f-37163a40c8e2 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1265 microversion: 2.1 time: 0.166406 Sep 03 01:40:56.368378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 553/1132] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:56 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:40:56.527414 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e640b1bc-3df8-42f2-813c-7ddbb4b1a571 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 204 len: 0 microversion: 2.1 time: 0.355805 Sep 03 01:40:56.528037 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 580/1133] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:40:56 2022] DELETE /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 0 bytes in 357 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:40:56.536600 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-668a4342-ee34-447d-b828-0ccef0b137bb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:56.537209 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-668a4342-ee34-447d-b828-0ccef0b137bb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:56.543813 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-668a4342-ee34-447d-b828-0ccef0b137bb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:56.544292 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-668a4342-ee34-447d-b828-0ccef0b137bb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:56.544722 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-668a4342-ee34-447d-b828-0ccef0b137bb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:56.545404 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-668a4342-ee34-447d-b828-0ccef0b137bb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:56.545852 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-668a4342-ee34-447d-b828-0ccef0b137bb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:56.546271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-668a4342-ee34-447d-b828-0ccef0b137bb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:56.678261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-668a4342-ee34-447d-b828-0ccef0b137bb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:56.686185 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-668a4342-ee34-447d-b828-0ccef0b137bb tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1681 microversion: 2.1 time: 0.153683 Sep 03 01:40:56.686802 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 554/1134] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:56 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:57.383397 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-62665882-ddfd-42b6-926c-b4184b025296 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:57.384201 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-62665882-ddfd-42b6-926c-b4184b025296 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:57.390824 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62665882-ddfd-42b6-926c-b4184b025296 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:57.391303 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62665882-ddfd-42b6-926c-b4184b025296 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:57.391737 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62665882-ddfd-42b6-926c-b4184b025296 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:57.392471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62665882-ddfd-42b6-926c-b4184b025296 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:57.392916 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62665882-ddfd-42b6-926c-b4184b025296 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:57.393328 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62665882-ddfd-42b6-926c-b4184b025296 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:57.530945 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-62665882-ddfd-42b6-926c-b4184b025296 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:57.539414 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-62665882-ddfd-42b6-926c-b4184b025296 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1265 microversion: 2.1 time: 0.160307 Sep 03 01:40:57.539985 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 581/1135] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:57 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:57.709271 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e4196110-57cd-44af-8fe9-134d85d8a938 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:57.709915 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e4196110-57cd-44af-8fe9-134d85d8a938 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:57.716902 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e4196110-57cd-44af-8fe9-134d85d8a938 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:57.717384 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e4196110-57cd-44af-8fe9-134d85d8a938 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:57.717850 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e4196110-57cd-44af-8fe9-134d85d8a938 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:57.718563 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e4196110-57cd-44af-8fe9-134d85d8a938 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:57.719036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e4196110-57cd-44af-8fe9-134d85d8a938 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:57.719457 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e4196110-57cd-44af-8fe9-134d85d8a938 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:57.868242 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e4196110-57cd-44af-8fe9-134d85d8a938 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:57.873904 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-aefe1887-290f-4acf-b535-6f2dd8a74f88 req-d0eccf18-2623-4e13-9bec-c1d61b285289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76830239-8685-42c5-98e6-e5fd654d77d7", "name": "network-vif-plugged", "status": "completed", "tag": "9ea8f48a-f00d-4263-8d2c-f16a754b34e4"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:40:57.886585 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e4196110-57cd-44af-8fe9-134d85d8a938 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1681 microversion: 2.1 time: 0.181059 Sep 03 01:40:57.887184 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 555/1136] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:57 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:57.888884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-aefe1887-290f-4acf-b535-6f2dd8a74f88 req-d0eccf18-2623-4e13-9bec-c1d61b285289 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:57.889367 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-aefe1887-290f-4acf-b535-6f2dd8a74f88 req-d0eccf18-2623-4e13-9bec-c1d61b285289 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:57.889800 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-aefe1887-290f-4acf-b535-6f2dd8a74f88 req-d0eccf18-2623-4e13-9bec-c1d61b285289 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:57.902097 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-aefe1887-290f-4acf-b535-6f2dd8a74f88 req-d0eccf18-2623-4e13-9bec-c1d61b285289 service nova] Creating event network-vif-plugged:9ea8f48a-f00d-4263-8d2c-f16a754b34e4 for instance 76830239-8685-42c5-98e6-e5fd654d77d7 on hv-cinder-83800 Sep 03 01:40:57.907237 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-aefe1887-290f-4acf-b535-6f2dd8a74f88 req-d0eccf18-2623-4e13-9bec-c1d61b285289 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044846 Sep 03 01:40:57.907913 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 582/1137] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:40:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:40:58.562754 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6a86ecc7-194e-4f18-8df4-1e8bfeaa8c60 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:58.563481 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6a86ecc7-194e-4f18-8df4-1e8bfeaa8c60 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:58.569579 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6a86ecc7-194e-4f18-8df4-1e8bfeaa8c60 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:58.570171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6a86ecc7-194e-4f18-8df4-1e8bfeaa8c60 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:58.570705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6a86ecc7-194e-4f18-8df4-1e8bfeaa8c60 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:58.571478 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6a86ecc7-194e-4f18-8df4-1e8bfeaa8c60 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:58.572006 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6a86ecc7-194e-4f18-8df4-1e8bfeaa8c60 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:58.572538 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6a86ecc7-194e-4f18-8df4-1e8bfeaa8c60 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:58.729307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6a86ecc7-194e-4f18-8df4-1e8bfeaa8c60 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:58.737570 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6a86ecc7-194e-4f18-8df4-1e8bfeaa8c60 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1265 microversion: 2.1 time: 0.178631 Sep 03 01:40:58.738508 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 556/1138] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:58 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:58.911276 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-18ea347c-93b9-45eb-8e50-3372eda47901 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:58.912226 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-18ea347c-93b9-45eb-8e50-3372eda47901 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:58.923106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-18ea347c-93b9-45eb-8e50-3372eda47901 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:58.923890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-18ea347c-93b9-45eb-8e50-3372eda47901 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:58.924723 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-18ea347c-93b9-45eb-8e50-3372eda47901 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:58.925673 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-18ea347c-93b9-45eb-8e50-3372eda47901 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:58.926232 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-18ea347c-93b9-45eb-8e50-3372eda47901 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:58.926921 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-18ea347c-93b9-45eb-8e50-3372eda47901 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:59.022420 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-18ea347c-93b9-45eb-8e50-3372eda47901 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:59.030866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-18ea347c-93b9-45eb-8e50-3372eda47901 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1613 microversion: 2.1 time: 0.124079 Sep 03 01:40:59.031443 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 583/1139] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:58 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1613 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:59.217334 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-a24efa93-38f7-4ea7-b87f-35ff8458c2b8 req-95003beb-04d8-42cd-9f64-1d1fe8286d01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "339527e0-bd33-4cfb-950f-ccb7a68a69bc", "name": "network-vif-deleted", "tag": "914b4f37-4e68-434b-abc8-978883c344a6"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:40:59.226597 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-a24efa93-38f7-4ea7-b87f-35ff8458c2b8 req-95003beb-04d8-42cd-9f64-1d1fe8286d01 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:59.227077 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-a24efa93-38f7-4ea7-b87f-35ff8458c2b8 req-95003beb-04d8-42cd-9f64-1d1fe8286d01 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:59.227529 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-a24efa93-38f7-4ea7-b87f-35ff8458c2b8 req-95003beb-04d8-42cd-9f64-1d1fe8286d01 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:59.248454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-a24efa93-38f7-4ea7-b87f-35ff8458c2b8 req-95003beb-04d8-42cd-9f64-1d1fe8286d01 service nova] Creating event network-vif-deleted:914b4f37-4e68-434b-abc8-978883c344a6 for instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc on hv-cinder-83800 Sep 03 01:40:59.248454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-a24efa93-38f7-4ea7-b87f-35ff8458c2b8 req-95003beb-04d8-42cd-9f64-1d1fe8286d01 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031867 Sep 03 01:40:59.248454 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 557/1140] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:40:59.761776 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b701d51b-28e0-4947-9de8-47d09d78dde4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:59.762245 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b701d51b-28e0-4947-9de8-47d09d78dde4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:40:59.778831 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b701d51b-28e0-4947-9de8-47d09d78dde4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:59.783022 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b701d51b-28e0-4947-9de8-47d09d78dde4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:59.783530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b701d51b-28e0-4947-9de8-47d09d78dde4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:59.785202 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b701d51b-28e0-4947-9de8-47d09d78dde4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:40:59.785832 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b701d51b-28e0-4947-9de8-47d09d78dde4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:40:59.786480 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b701d51b-28e0-4947-9de8-47d09d78dde4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:40:59.943901 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b701d51b-28e0-4947-9de8-47d09d78dde4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:40:59.955109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b701d51b-28e0-4947-9de8-47d09d78dde4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1451 microversion: 2.1 time: 0.198243 Sep 03 01:40:59.956132 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 584/1141] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:59 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1451 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:40:59.985383 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-37cc334b-dcc1-4502-b5dc-ee72af4b4cd1 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:40:59.986092 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-37cc334b-dcc1-4502-b5dc-ee72af4b4cd1 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:00.004745 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37cc334b-dcc1-4502-b5dc-ee72af4b4cd1 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:00.004745 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37cc334b-dcc1-4502-b5dc-ee72af4b4cd1 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:00.004745 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37cc334b-dcc1-4502-b5dc-ee72af4b4cd1 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:00.004745 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37cc334b-dcc1-4502-b5dc-ee72af4b4cd1 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:00.005288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37cc334b-dcc1-4502-b5dc-ee72af4b4cd1 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:00.005288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-37cc334b-dcc1-4502-b5dc-ee72af4b4cd1 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:00.060282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:00.062149 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:00.072886 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:00.073392 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:00.077640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:00.078589 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:00.079060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:00.081153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:00.120709 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:00.121246 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:00.121685 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:00.122135 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lazy-loading 'fault' on Instance uuid 339527e0-bd33-4cfb-950f-ccb7a68a69bc {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:41:00.170199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b9ab1983bb84318b509878b930e9402', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02813cf0683749ee87b039b28f1aeebb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:00.178567 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ad6c8f35-a26c-43cd-b2fd-0729ea2b701e tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 200 len: 1332 microversion: 2.1 time: 0.127475 Sep 03 01:41:00.179153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 585/1142] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:41:00 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 1332 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:41:00.188749 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-37cc334b-dcc1-4502-b5dc-ee72af4b4cd1 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:00.197553 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-37cc334b-dcc1-4502-b5dc-ee72af4b4cd1 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1451 microversion: 2.1 time: 0.217308 Sep 03 01:41:00.198470 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 558/1143] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:40:59 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1451 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:41:01.203418 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3c6d1c3e-24d7-48e8-ae67-64dfd3897bd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:01.208259 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-3c6d1c3e-24d7-48e8-ae67-64dfd3897bd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:01.211513 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3c6d1c3e-24d7-48e8-ae67-64dfd3897bd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:01.212872 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3c6d1c3e-24d7-48e8-ae67-64dfd3897bd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:01.213311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3c6d1c3e-24d7-48e8-ae67-64dfd3897bd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:01.214197 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3c6d1c3e-24d7-48e8-ae67-64dfd3897bd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:01.214689 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3c6d1c3e-24d7-48e8-ae67-64dfd3897bd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:01.215175 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3c6d1c3e-24d7-48e8-ae67-64dfd3897bd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:01.230801 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-3c6d1c3e-24d7-48e8-ae67-64dfd3897bd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3c6d1c3e-24d7-48e8-ae67-64dfd3897bd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc HTTP/1.1 Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:41:01.232623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:41:01.234203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:01.234203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:01.234203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:01.234203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:01.234203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:01.234203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:41:01.234203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:41:01.234203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:41:01.234203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:01.234203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:41:01.234203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:01.234203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '339527e0-bd33-4cfb-950f-ccb7a68a69bc'} Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:01.236103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:01.237438 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:01.239365 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3c6d1c3e-24d7-48e8-ae67-64dfd3897bd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 404 to user: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:01.239365 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3c6d1c3e-24d7-48e8-ae67-64dfd3897bd8 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 404 len: 111 microversion: 2.1 time: 0.034837 Sep 03 01:41:01.239365 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 586/1144] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:41:01 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:41:01.243283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-fc6a20a1-2fcf-4e05-8f02-8045f988951d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '.version_select at 0x7f6d249e2e50>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:01.361649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-fc6a20a1-2fcf-4e05-8f02-8045f988951d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1242611918" status: 202 len: 0 microversion: 2.1 time: 0.122249 Sep 03 01:41:01.362234 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 559/1145] 10.222.0.13 () {58 vars in 1221 bytes} [Sat Sep 3 01:41:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1242611918 => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:41:02.857572 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-5400adc0-57e8-4608-b9ba-38e99d6bbcf0 req-7c159b0e-fd3e-4c8b-9b9f-5970982001bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76830239-8685-42c5-98e6-e5fd654d77d7", "tag": "9ea8f48a-f00d-4263-8d2c-f16a754b34e4"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:41:02.869768 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-5400adc0-57e8-4608-b9ba-38e99d6bbcf0 req-7c159b0e-fd3e-4c8b-9b9f-5970982001bc service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:02.872796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-5400adc0-57e8-4608-b9ba-38e99d6bbcf0 req-7c159b0e-fd3e-4c8b-9b9f-5970982001bc service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:02.872796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-5400adc0-57e8-4608-b9ba-38e99d6bbcf0 req-7c159b0e-fd3e-4c8b-9b9f-5970982001bc service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:02.882734 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-5400adc0-57e8-4608-b9ba-38e99d6bbcf0 req-7c159b0e-fd3e-4c8b-9b9f-5970982001bc service nova] Creating event network-changed:9ea8f48a-f00d-4263-8d2c-f16a754b34e4 for instance 76830239-8685-42c5-98e6-e5fd654d77d7 on hv-cinder-83800 Sep 03 01:41:02.888884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-5400adc0-57e8-4608-b9ba-38e99d6bbcf0 req-7c159b0e-fd3e-4c8b-9b9f-5970982001bc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035144 Sep 03 01:41:02.889802 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 587/1146] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:41:03.802563 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2ed7e3ae-5513-4eca-a1f7-1850b1f3ee6b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:03.802563 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2ed7e3ae-5513-4eca-a1f7-1850b1f3ee6b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:03.816184 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2ed7e3ae-5513-4eca-a1f7-1850b1f3ee6b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:03.816957 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2ed7e3ae-5513-4eca-a1f7-1850b1f3ee6b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:03.817590 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2ed7e3ae-5513-4eca-a1f7-1850b1f3ee6b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:03.818633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2ed7e3ae-5513-4eca-a1f7-1850b1f3ee6b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:03.818986 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2ed7e3ae-5513-4eca-a1f7-1850b1f3ee6b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:03.819430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2ed7e3ae-5513-4eca-a1f7-1850b1f3ee6b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:03.844336 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-2ed7e3ae-5513-4eca-a1f7-1850b1f3ee6b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2ed7e3ae-5513-4eca-a1f7-1850b1f3ee6b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: DELETE /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc HTTP/1.1 Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:41:03.847139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:41:03.848733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:03.848733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:03.848733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:03.848733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:03.848733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:03.848733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:41:03.848733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:41:03.848733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:41:03.848733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:03.848733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:41:03.848733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:03.848733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '339527e0-bd33-4cfb-950f-ccb7a68a69bc'} Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:03.849592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:03.852052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:03.855017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2ed7e3ae-5513-4eca-a1f7-1850b1f3ee6b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 404 to user: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:03.855017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2ed7e3ae-5513-4eca-a1f7-1850b1f3ee6b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 404 len: 111 microversion: 2.1 time: 0.071615 Sep 03 01:41:03.855017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 560/1147] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:41:03 2022] DELETE /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:41:03.863942 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e22e53ef-bf8f-4eed-9fe0-733a16379745 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:03.866147 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e22e53ef-bf8f-4eed-9fe0-733a16379745 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 339527e0-bd33-4cfb-950f-ccb7a68a69bc] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:03.887049 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e22e53ef-bf8f-4eed-9fe0-733a16379745 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:03.887887 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e22e53ef-bf8f-4eed-9fe0-733a16379745 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:03.888488 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e22e53ef-bf8f-4eed-9fe0-733a16379745 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:03.889351 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e22e53ef-bf8f-4eed-9fe0-733a16379745 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:03.890993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e22e53ef-bf8f-4eed-9fe0-733a16379745 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:03.891749 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e22e53ef-bf8f-4eed-9fe0-733a16379745 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:03.916467 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-e22e53ef-bf8f-4eed-9fe0-733a16379745 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e22e53ef-bf8f-4eed-9fe0-733a16379745 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc HTTP/1.1 Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:41:03.920909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:41:03.930767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:03.930767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:03.930767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:03.930767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:03.930767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:03.930767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:41:03.930767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:41:03.930767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:41:03.930767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:03.930767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:41:03.930767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:03.930767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '339527e0-bd33-4cfb-950f-ccb7a68a69bc'} Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:03.932793 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. Sep 03 01:41:03.934634 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:03.936109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e22e53ef-bf8f-4eed-9fe0-733a16379745 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 404 to user: Instance 339527e0-bd33-4cfb-950f-ccb7a68a69bc could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:03.936109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e22e53ef-bf8f-4eed-9fe0-733a16379745 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc" status: 404 len: 111 microversion: 2.1 time: 0.067038 Sep 03 01:41:03.936109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 588/1148] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:41:03 2022] GET /compute/v2.1/servers/339527e0-bd33-4cfb-950f-ccb7a68a69bc => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:41:05.217010 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8e938b4c-265f-4f02-9bfe-2300308d5309 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:05.217551 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-8e938b4c-265f-4f02-9bfe-2300308d5309 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:05.223612 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8e938b4c-265f-4f02-9bfe-2300308d5309 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:05.225917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8e938b4c-265f-4f02-9bfe-2300308d5309 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:05.225917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8e938b4c-265f-4f02-9bfe-2300308d5309 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:05.225917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8e938b4c-265f-4f02-9bfe-2300308d5309 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:05.225917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8e938b4c-265f-4f02-9bfe-2300308d5309 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:05.226309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-8e938b4c-265f-4f02-9bfe-2300308d5309 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:05.240388 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-8e938b4c-265f-4f02-9bfe-2300308d5309 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8e938b4c-265f-4f02-9bfe-2300308d5309 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: DELETE /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 HTTP/1.1 Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:41:05.241963 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:41:05.244066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:05.244066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:05.244066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:05.244066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:05.244066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:05.244066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:41:05.244066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:41:05.244066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:41:05.244066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:05.244066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:41:05.244066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:41:05.244066 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '3fb78ff3-5840-45d5-8185-450243588142'} Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:05.244826 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:41:05.246572 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.248296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-8e938b4c-265f-4f02-9bfe-2300308d5309 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 404 to user: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:05.248296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8e938b4c-265f-4f02-9bfe-2300308d5309 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 404 len: 111 microversion: 2.1 time: 0.031749 Sep 03 01:41:05.248296 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 561/1149] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:41:05 2022] DELETE /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:41:05.252770 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7e107aa1-4edb-4870-b928-9ebdb048074d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:05.254426 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7e107aa1-4edb-4870-b928-9ebdb048074d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 3fb78ff3-5840-45d5-8185-450243588142] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:05.260742 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e107aa1-4edb-4870-b928-9ebdb048074d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:05.261223 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e107aa1-4edb-4870-b928-9ebdb048074d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:05.261761 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e107aa1-4edb-4870-b928-9ebdb048074d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:05.262358 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e107aa1-4edb-4870-b928-9ebdb048074d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:05.262809 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e107aa1-4edb-4870-b928-9ebdb048074d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:05.263229 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e107aa1-4edb-4870-b928-9ebdb048074d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:05.276711 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-7e107aa1-4edb-4870-b928-9ebdb048074d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7e107aa1-4edb-4870-b928-9ebdb048074d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 HTTP/1.1 Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:41:05.278238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:41:05.279690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:05.279690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:05.279690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:05.279690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:05.279690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:05.279690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:41:05.279690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:41:05.279690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:41:05.279690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:05.279690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:41:05.279690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:41:05.279690 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '3fb78ff3-5840-45d5-8185-450243588142'} Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:05.280432 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. Sep 03 01:41:05.281677 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.282847 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7e107aa1-4edb-4870-b928-9ebdb048074d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 404 to user: Instance 3fb78ff3-5840-45d5-8185-450243588142 could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:05.282847 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7e107aa1-4edb-4870-b928-9ebdb048074d tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142" status: 404 len: 111 microversion: 2.1 time: 0.030783 Sep 03 01:41:05.282847 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 589/1150] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:41:05 2022] GET /compute/v2.1/servers/3fb78ff3-5840-45d5-8185-450243588142 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:41:05.288948 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-dd7845e1-d60a-4252-bc81-6f11d21fd0c7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:05.289451 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-dd7845e1-d60a-4252-bc81-6f11d21fd0c7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:05.296545 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd7845e1-d60a-4252-bc81-6f11d21fd0c7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:05.297047 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd7845e1-d60a-4252-bc81-6f11d21fd0c7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:05.297652 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd7845e1-d60a-4252-bc81-6f11d21fd0c7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:05.298250 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd7845e1-d60a-4252-bc81-6f11d21fd0c7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:05.298814 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd7845e1-d60a-4252-bc81-6f11d21fd0c7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:05.299245 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd7845e1-d60a-4252-bc81-6f11d21fd0c7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:05.314319 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-dd7845e1-d60a-4252-bc81-6f11d21fd0c7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-dd7845e1-d60a-4252-bc81-6f11d21fd0c7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: DELETE /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 HTTP/1.1 Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:41:05.315901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:41:05.317261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:05.317261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:05.317261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:05.317261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:05.317261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:05.317261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:41:05.317261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:41:05.317261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:41:05.317261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:05.317261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:41:05.317261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:41:05.317261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '0cc53030-cbc9-48c7-8b91-8e23455b23b8'} Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:05.318063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:41:05.319360 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.321010 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-dd7845e1-d60a-4252-bc81-6f11d21fd0c7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 404 to user: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:05.321010 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-dd7845e1-d60a-4252-bc81-6f11d21fd0c7 tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 404 len: 111 microversion: 2.1 time: 0.032335 Sep 03 01:41:05.322498 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 562/1151] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:41:05 2022] DELETE /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:41:05.326378 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-69ad2086-3c35-4282-9899-511e004e500b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:05.327002 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-69ad2086-3c35-4282-9899-511e004e500b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 0cc53030-cbc9-48c7-8b91-8e23455b23b8] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:05.332806 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-69ad2086-3c35-4282-9899-511e004e500b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:05.333282 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-69ad2086-3c35-4282-9899-511e004e500b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:05.333891 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-69ad2086-3c35-4282-9899-511e004e500b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:05.334771 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-69ad2086-3c35-4282-9899-511e004e500b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:05.335220 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-69ad2086-3c35-4282-9899-511e004e500b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:05.335877 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-69ad2086-3c35-4282-9899-511e004e500b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:05.349911 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-69ad2086-3c35-4282-9899-511e004e500b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-69ad2086-3c35-4282-9899-511e004e500b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 HTTP/1.1 Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:41:05.351459 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:41:05.353215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:05.353215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:05.353215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:05.353215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:05.353215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:05.353215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:41:05.353215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:41:05.353215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:41:05.353215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:05.353215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:41:05.353215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:41:05.353215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '0cc53030-cbc9-48c7-8b91-8e23455b23b8'} Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:05.354867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. Sep 03 01:41:05.357554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:05.360033 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-69ad2086-3c35-4282-9899-511e004e500b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 404 to user: Instance 0cc53030-cbc9-48c7-8b91-8e23455b23b8 could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:05.360033 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-69ad2086-3c35-4282-9899-511e004e500b tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8" status: 404 len: 111 microversion: 2.1 time: 0.030404 Sep 03 01:41:05.360033 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 590/1152] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:41:05 2022] GET /compute/v2.1/servers/0cc53030-cbc9-48c7-8b91-8e23455b23b8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:41:06.697050 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-dd242c40-9eb8-40e8-abfb-18bf627a67ab tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:06.697675 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-dd242c40-9eb8-40e8-abfb-18bf627a67ab tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:06.704437 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd242c40-9eb8-40e8-abfb-18bf627a67ab tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:06.704929 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd242c40-9eb8-40e8-abfb-18bf627a67ab tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:06.705373 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd242c40-9eb8-40e8-abfb-18bf627a67ab tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:06.706079 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd242c40-9eb8-40e8-abfb-18bf627a67ab tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:06.706565 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd242c40-9eb8-40e8-abfb-18bf627a67ab tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:06.706995 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-dd242c40-9eb8-40e8-abfb-18bf627a67ab tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:06.720840 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-dd242c40-9eb8-40e8-abfb-18bf627a67ab tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-dd242c40-9eb8-40e8-abfb-18bf627a67ab tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: DELETE /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb HTTP/1.1 Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:41:06.722435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:41:06.724106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:06.724106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:06.724106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:06.724106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:06.724106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:06.724106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:41:06.724106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:41:06.724106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:41:06.724106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:06.724106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:41:06.724106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:41:06.724106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb'} Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:06.724984 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:41:06.731791 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:06.733139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-dd242c40-9eb8-40e8-abfb-18bf627a67ab tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 404 to user: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:06.733139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-dd242c40-9eb8-40e8-abfb-18bf627a67ab tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 404 len: 111 microversion: 2.1 time: 0.031463 Sep 03 01:41:06.733139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 563/1153] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:41:06 2022] DELETE /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:41:06.738755 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3fe015e1-efcb-41df-8f69-33af541e712f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:06.739398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-3fe015e1-efcb-41df-8f69-33af541e712f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] [instance: 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:06.746384 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3fe015e1-efcb-41df-8f69-33af541e712f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:06.746844 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3fe015e1-efcb-41df-8f69-33af541e712f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:06.747319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3fe015e1-efcb-41df-8f69-33af541e712f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:06.748000 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3fe015e1-efcb-41df-8f69-33af541e712f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:06.748442 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3fe015e1-efcb-41df-8f69-33af541e712f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:06.748860 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-3fe015e1-efcb-41df-8f69-33af541e712f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:06.763638 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-3fe015e1-efcb-41df-8f69-33af541e712f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] HTTP exception thrown: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3fe015e1-efcb-41df-8f69-33af541e712f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Request method failure captured: Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb HTTP/1.1 Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7UzyuGBJFSn9phajWdcy6i57iIkTqqJVqAoPYhfqImVFTMZd4InEK5W1EnsbiDykav4RbfXyO4jQtfmlUZuxfay-vGN6zndWxjwALRJhYFFqkPGGEwMgA5z7yOw8_kPJwxlQGqsliw4wZZYS1zQQsMSJcTPIsm7RImQM_Me-4k2sg Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:41:06.765244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:41:06.766998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/02813cf0683749ee87b039b28f1aeebb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:06.766998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:06.766998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 02813cf0683749ee87b039b28f1aeebb Sep 03 01:41:06.766998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-48379467 Sep 03 01:41:06.766998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:06.766998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:41:06.766998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:41:06.766998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 2b9ab1983bb84318b509878b930e9402 Sep 03 01:41:06.766998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-AttachVolumeNegativeTest-48379467-project Sep 03 01:41:06.766998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:41:06.766998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:41:06.766998 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb'} Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:06.767881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. Sep 03 01:41:06.769103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:06.770244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-3fe015e1-efcb-41df-8f69-33af541e712f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] Returning 404 to user: Instance 4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:06.770244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-3fe015e1-efcb-41df-8f69-33af541e712f tempest-AttachVolumeNegativeTest-48379467 tempest-AttachVolumeNegativeTest-48379467-project] 10.222.0.13 "GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb" status: 404 len: 111 microversion: 2.1 time: 0.031827 Sep 03 01:41:06.770244 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 591/1154] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:41:06 2022] GET /compute/v2.1/servers/4bfe7afd-f5ea-482c-8cb2-6e5bf095dcbb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 01:41:12.437310 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c7cc4cd2-a93e-4e99-84c7-c12b9ee18424 tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] Action: 'create', calling method: .version_select at 0x7f6d2486cee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1562432377", "metadata": {"Type": "work"}}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:41:13.090713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c7cc4cd2-a93e-4e99-84c7-c12b9ee18424 tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.806980 Sep 03 01:41:13.091330 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 564/1155] 10.222.0.13 () {60 vars in 1156 bytes} [Sat Sep 3 01:41:12 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 808 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 03 01:41:13.104133 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-dbc5652b-bd00-43f7-b3ea-7276b538421a tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] Calling method '.version_select at 0x7f6d28153040>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:13.156853 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-dbc5652b-bd00-43f7-b3ea-7276b538421a tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/25a51b3f-0b8d-4f5a-a60d-d273bdc94911" status: 200 len: 353 microversion: 2.1 time: 0.056543 Sep 03 01:41:13.157712 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 592/1156] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:41:13 2022] GET /compute/v2.1/os-volumes/25a51b3f-0b8d-4f5a-a60d-d273bdc94911 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:41:14.172064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-5f835ac6-b609-4b4d-aaea-9c37c3221d14 tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] Calling method '.version_select at 0x7f6d249f9040>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:14.219334 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-5f835ac6-b609-4b4d-aaea-9c37c3221d14 tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/25a51b3f-0b8d-4f5a-a60d-d273bdc94911" status: 200 len: 354 microversion: 2.1 time: 0.051419 Sep 03 01:41:14.219900 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 565/1157] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:41:14 2022] GET /compute/v2.1/os-volumes/25a51b3f-0b8d-4f5a-a60d-d273bdc94911 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:41:14.234257 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-dc5b1713-284e-4e46-af2f-eb76fed0b892 tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] Calling method '.version_select at 0x7f6d280c91f0>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:14.280017 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-dc5b1713-284e-4e46-af2f-eb76fed0b892 tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/25a51b3f-0b8d-4f5a-a60d-d273bdc94911" status: 200 len: 354 microversion: 2.1 time: 0.050029 Sep 03 01:41:14.280898 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 593/1158] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:41:14 2022] GET /compute/v2.1/os-volumes/25a51b3f-0b8d-4f5a-a60d-d273bdc94911 => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:41:14.300272 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-1ba390e7-9bbd-4d9f-bb55-c7f05bbdf383 tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] Calling method '.version_select at 0x7f6d2478d5e0>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:14.539426 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-1ba390e7-9bbd-4d9f-bb55-c7f05bbdf383 tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/25a51b3f-0b8d-4f5a-a60d-d273bdc94911" status: 202 len: 0 microversion: 2.1 time: 0.243075 Sep 03 01:41:14.540577 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 566/1159] 10.222.0.13 () {58 vars in 1248 bytes} [Sat Sep 3 01:41:14 2022] DELETE /compute/v2.1/os-volumes/25a51b3f-0b8d-4f5a-a60d-d273bdc94911 => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:41:14.549015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-dc454c91-4167-4609-a2b3-6d127dfb3971 tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] Calling method '.version_select at 0x7f6d280adc10>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:14.596707 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-dc454c91-4167-4609-a2b3-6d127dfb3971 tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/25a51b3f-0b8d-4f5a-a60d-d273bdc94911" status: 200 len: 353 microversion: 2.1 time: 0.051498 Sep 03 01:41:14.597277 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 594/1160] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:41:14 2022] GET /compute/v2.1/os-volumes/25a51b3f-0b8d-4f5a-a60d-d273bdc94911 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:41:15.612089 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0774a411-e132-432a-923c-1bedbfd5d56c tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] Calling method '.version_select at 0x7f6d24998700>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:15.640879 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-0774a411-e132-432a-923c-1bedbfd5d56c tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] HTTP exception thrown: Volume 25a51b3f-0b8d-4f5a-a60d-d273bdc94911 could not be found. Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0774a411-e132-432a-923c-1bedbfd5d56c tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] Request method failure captured: Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/os-volumes/25a51b3f-0b8d-4f5a-a60d-d273bdc94911 HTTP/1.1 Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjErC44BORKUsWrubub2XAdOCV6N5SiIGJWSK68EIs-j82rz4oJBd5dZTzDyji082SKOZjSDhiPjKKV7mwNlM9an7RJzYhwGHZI3UY-5p3Vt2-jX_KsHNikdw6Jw85Wv4EdSqNah8WbnRaoP0b5bzDBIVOeP8zXJpnPzEJG1IE7y-wQDM Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 31be2034a71241d99b13017142fc4297 Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-VolumesGetTestJSON-594563995 Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:41:15.642972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:41:15.644659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_31be2034a71241d99b13017142fc4297"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/31be2034a71241d99b13017142fc4297"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/31be2034a71241d99b13017142fc4297"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/31be2034a71241d99b13017142fc4297"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:15.644659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-VolumesGetTestJSON-594563995 Sep 03 01:41:15.644659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 31be2034a71241d99b13017142fc4297 Sep 03 01:41:15.644659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-VolumesGetTestJSON-594563995 Sep 03 01:41:15.644659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-VolumesGetTestJSON-594563995-project Sep 03 01:41:15.644659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:41:15.644659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:41:15.644659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 67581bdc0c8d4344ae33cc0b974dc401 Sep 03 01:41:15.644659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-VolumesGetTestJSON-594563995-project Sep 03 01:41:15.644659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: Sep 03 01:41:15.644659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Volume 25a51b3f-0b8d-4f5a-a60d-d273bdc94911 could not be found. Sep 03 01:41:15.644659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '25a51b3f-0b8d-4f5a-a60d-d273bdc94911'} Sep 03 01:41:15.644659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 25a51b3f-0b8d-4f5a-a60d-d273bdc94911 could not be found. (HTTP 404) (Request-ID: req-12166188-1d69-445f-b1ce-525abc1ea46e) Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:15.645688 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 01:41:15.648378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 25a51b3f-0b8d-4f5a-a60d-d273bdc94911 could not be found. Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 03 01:41:15.650845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 25a51b3f-0b8d-4f5a-a60d-d273bdc94911 could not be found. Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 25a51b3f-0b8d-4f5a-a60d-d273bdc94911 could not be found. Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0774a411-e132-432a-923c-1bedbfd5d56c tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] Returning 404 to user: Volume 25a51b3f-0b8d-4f5a-a60d-d273bdc94911 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0774a411-e132-432a-923c-1bedbfd5d56c tempest-VolumesGetTestJSON-594563995 tempest-VolumesGetTestJSON-594563995-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/25a51b3f-0b8d-4f5a-a60d-d273bdc94911" status: 404 len: 109 microversion: 2.1 time: 0.036849 Sep 03 01:41:15.652633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 567/1161] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:41:15 2022] GET /compute/v2.1/os-volumes/25a51b3f-0b8d-4f5a-a60d-d273bdc94911 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 03 01:41:21.351024 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:41:21.351784 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:41:21.356791 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2f77fdc6-c547-4710-8f42-03dc08d69885 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:21.359052 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2f77fdc6-c547-4710-8f42-03dc08d69885 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:21.364813 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2f77fdc6-c547-4710-8f42-03dc08d69885 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:21.365296 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2f77fdc6-c547-4710-8f42-03dc08d69885 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:21.365716 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2f77fdc6-c547-4710-8f42-03dc08d69885 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:21.366440 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2f77fdc6-c547-4710-8f42-03dc08d69885 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:21.366890 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2f77fdc6-c547-4710-8f42-03dc08d69885 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:21.367319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2f77fdc6-c547-4710-8f42-03dc08d69885 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:21.397023 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2f77fdc6-c547-4710-8f42-03dc08d69885 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047269 Sep 03 01:41:21.397530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 595/1162] 10.222.0.13 () {60 vars in 1343 bytes} [Sat Sep 3 01:41:21 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:41:21.459939 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:41:21.460853 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=56 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:41:21.465758 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d4669b49-f961-4d82-8ccb-dae36b03b06b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:21.466260 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d4669b49-f961-4d82-8ccb-dae36b03b06b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:21.472137 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4669b49-f961-4d82-8ccb-dae36b03b06b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:21.472637 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4669b49-f961-4d82-8ccb-dae36b03b06b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:21.473063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4669b49-f961-4d82-8ccb-dae36b03b06b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:21.473754 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4669b49-f961-4d82-8ccb-dae36b03b06b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:21.474214 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4669b49-f961-4d82-8ccb-dae36b03b06b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:21.474700 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d4669b49-f961-4d82-8ccb-dae36b03b06b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:21.499551 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d4669b49-f961-4d82-8ccb-dae36b03b06b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:41:21.829905 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d4669b49-f961-4d82-8ccb-dae36b03b06b tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 204 len: 0 microversion: 2.20 time: 0.371605 Sep 03 01:41:21.830535 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 568/1163] 10.222.0.13 () {60 vars in 1280 bytes} [Sat Sep 3 01:41:21 2022] DELETE /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 01:41:21.839625 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-980d650f-7262-47c5-a220-e4ed9a5b34b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:21.840226 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-980d650f-7262-47c5-a220-e4ed9a5b34b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:21.847402 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-980d650f-7262-47c5-a220-e4ed9a5b34b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:21.847863 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-980d650f-7262-47c5-a220-e4ed9a5b34b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:21.848319 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-980d650f-7262-47c5-a220-e4ed9a5b34b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:21.849003 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-980d650f-7262-47c5-a220-e4ed9a5b34b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:21.849444 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-980d650f-7262-47c5-a220-e4ed9a5b34b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:21.849861 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-980d650f-7262-47c5-a220-e4ed9a5b34b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:21.985281 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-980d650f-7262-47c5-a220-e4ed9a5b34b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:21.994414 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-980d650f-7262-47c5-a220-e4ed9a5b34b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:21.995652 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-980d650f-7262-47c5-a220-e4ed9a5b34b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:21.996814 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-980d650f-7262-47c5-a220-e4ed9a5b34b6 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.161736 Sep 03 01:41:21.997372 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 596/1164] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:41:21 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:41:23.025668 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-94372d3d-a116-4581-b912-244b313a5f64 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:23.026377 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-94372d3d-a116-4581-b912-244b313a5f64 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:23.032714 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-94372d3d-a116-4581-b912-244b313a5f64 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:23.033234 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-94372d3d-a116-4581-b912-244b313a5f64 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:23.033660 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-94372d3d-a116-4581-b912-244b313a5f64 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:23.034358 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-94372d3d-a116-4581-b912-244b313a5f64 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:23.035533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-94372d3d-a116-4581-b912-244b313a5f64 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:23.035533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-94372d3d-a116-4581-b912-244b313a5f64 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:23.166494 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-94372d3d-a116-4581-b912-244b313a5f64 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:23.174666 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-94372d3d-a116-4581-b912-244b313a5f64 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:23.176200 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-94372d3d-a116-4581-b912-244b313a5f64 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:23.177288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-94372d3d-a116-4581-b912-244b313a5f64 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.156567 Sep 03 01:41:23.177845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 569/1165] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:41:23 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:41:24.205080 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-dd21750f-b044-40fb-90a6-6997080ca2d0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:24.205681 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-dd21750f-b044-40fb-90a6-6997080ca2d0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:24.212947 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd21750f-b044-40fb-90a6-6997080ca2d0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:24.213398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd21750f-b044-40fb-90a6-6997080ca2d0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:24.213830 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd21750f-b044-40fb-90a6-6997080ca2d0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:24.214547 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd21750f-b044-40fb-90a6-6997080ca2d0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:24.214993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd21750f-b044-40fb-90a6-6997080ca2d0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:24.215412 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd21750f-b044-40fb-90a6-6997080ca2d0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:24.350126 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dd21750f-b044-40fb-90a6-6997080ca2d0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:24.358889 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dd21750f-b044-40fb-90a6-6997080ca2d0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:24.360313 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dd21750f-b044-40fb-90a6-6997080ca2d0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:24.361560 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-dd21750f-b044-40fb-90a6-6997080ca2d0 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.160412 Sep 03 01:41:24.362112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 597/1166] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:41:24 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:41:25.387561 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c9cc7bda-e43c-41ff-9038-f39aa2e7ce95 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:25.388193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c9cc7bda-e43c-41ff-9038-f39aa2e7ce95 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:25.394380 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c9cc7bda-e43c-41ff-9038-f39aa2e7ce95 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:25.394870 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c9cc7bda-e43c-41ff-9038-f39aa2e7ce95 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:25.395307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c9cc7bda-e43c-41ff-9038-f39aa2e7ce95 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:25.396005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c9cc7bda-e43c-41ff-9038-f39aa2e7ce95 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:25.396460 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c9cc7bda-e43c-41ff-9038-f39aa2e7ce95 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:25.396883 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c9cc7bda-e43c-41ff-9038-f39aa2e7ce95 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:25.544202 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c9cc7bda-e43c-41ff-9038-f39aa2e7ce95 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:25.552339 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c9cc7bda-e43c-41ff-9038-f39aa2e7ce95 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:25.553831 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c9cc7bda-e43c-41ff-9038-f39aa2e7ce95 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:25.555020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c9cc7bda-e43c-41ff-9038-f39aa2e7ce95 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1723 microversion: 2.20 time: 0.171365 Sep 03 01:41:25.555598 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 570/1167] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:41:25 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:41:26.538587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-694f4138-9d13-4555-b1eb-2539bc755245 req-0fdfb938-6f0f-4d6c-8f13-f7c91498e239 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e156f97d-5465-4597-a836-c70692edfd41", "name": "network-vif-deleted", "tag": "b4585caf-c260-4618-ba71-326b4c35ffdf"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:41:26.553528 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-694f4138-9d13-4555-b1eb-2539bc755245 req-0fdfb938-6f0f-4d6c-8f13-f7c91498e239 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:26.563696 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-694f4138-9d13-4555-b1eb-2539bc755245 req-0fdfb938-6f0f-4d6c-8f13-f7c91498e239 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:26.563696 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-694f4138-9d13-4555-b1eb-2539bc755245 req-0fdfb938-6f0f-4d6c-8f13-f7c91498e239 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:26.566693 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-694f4138-9d13-4555-b1eb-2539bc755245 req-0fdfb938-6f0f-4d6c-8f13-f7c91498e239 service nova] Creating event network-vif-deleted:b4585caf-c260-4618-ba71-326b4c35ffdf for instance e156f97d-5465-4597-a836-c70692edfd41 on hv-cinder-83800 Sep 03 01:41:26.573495 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-694f4138-9d13-4555-b1eb-2539bc755245 req-0fdfb938-6f0f-4d6c-8f13-f7c91498e239 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038868 Sep 03 01:41:26.574306 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 598/1168] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:41:26.588476 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b9a8fd78-e517-407f-a5ea-2e1ad2e3b9ad tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:26.589648 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b9a8fd78-e517-407f-a5ea-2e1ad2e3b9ad tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:26.601947 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b9a8fd78-e517-407f-a5ea-2e1ad2e3b9ad tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:26.602849 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b9a8fd78-e517-407f-a5ea-2e1ad2e3b9ad tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:26.611477 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b9a8fd78-e517-407f-a5ea-2e1ad2e3b9ad tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:26.612164 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b9a8fd78-e517-407f-a5ea-2e1ad2e3b9ad tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:26.612650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b9a8fd78-e517-407f-a5ea-2e1ad2e3b9ad tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:26.613089 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b9a8fd78-e517-407f-a5ea-2e1ad2e3b9ad tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:26.713275 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b9a8fd78-e517-407f-a5ea-2e1ad2e3b9ad tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:26.735118 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b9a8fd78-e517-407f-a5ea-2e1ad2e3b9ad tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:26.738941 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b9a8fd78-e517-407f-a5ea-2e1ad2e3b9ad tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '29b4f0836bbf4684bdc6177e42b88b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09bed4b9f9741a8ab110a2676baee7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:41:26.740164 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b9a8fd78-e517-407f-a5ea-2e1ad2e3b9ad tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 200 len: 1655 microversion: 2.20 time: 0.157880 Sep 03 01:41:26.744366 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 571/1169] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:41:26 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 1655 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 03 01:41:27.767329 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8ffb5749-fd24-48da-9aea-d82a4579359d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:27.768047 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-8ffb5749-fd24-48da-9aea-d82a4579359d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:27.774750 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ffb5749-fd24-48da-9aea-d82a4579359d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:27.775224 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ffb5749-fd24-48da-9aea-d82a4579359d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:27.775655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ffb5749-fd24-48da-9aea-d82a4579359d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:27.776336 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ffb5749-fd24-48da-9aea-d82a4579359d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:27.776812 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ffb5749-fd24-48da-9aea-d82a4579359d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:27.777230 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8ffb5749-fd24-48da-9aea-d82a4579359d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:27.791814 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-8ffb5749-fd24-48da-9aea-d82a4579359d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] HTTP exception thrown: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8ffb5749-fd24-48da-9aea-d82a4579359d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Request method failure captured: Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 HTTP/1.1 Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7T4S5vaLoLkOelO1eKAZ94SsvgKx8nn0PlHVaKc3S3IfkHIWadTLp9Vho3tjTiMstVyv50HnZd5E16qwBjEuPO4KxgJI77i5_IhmusF5pyRLA2NqvyQ7TtQ6_6hiiIGiUeK4D5WGusqnjHzmw7njr2bwxZv5Ys82XSSEJ7DcNysls Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: e09bed4b9f9741a8ab110a2676baee7f Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:41:27.793118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:41:27.794640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:27.794640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:27.794640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: e09bed4b9f9741a8ab110a2676baee7f Sep 03 01:41:27.794640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:27.794640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-AttachVolumeShelveTestJSON-636719635-project Sep 03 01:41:27.794640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:41:27.794640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:41:27.794640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 29b4f0836bbf4684bdc6177e42b88b20 Sep 03 01:41:27.794640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-636719635-project Sep 03 01:41:27.794640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:41:27.794640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:27.794640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': 'e156f97d-5465-4597-a836-c70692edfd41'} Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:27.795422 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:27.796795 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:27.799381 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8ffb5749-fd24-48da-9aea-d82a4579359d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Returning 404 to user: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:27.799381 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-8ffb5749-fd24-48da-9aea-d82a4579359d tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 404 len: 111 microversion: 2.20 time: 0.031974 Sep 03 01:41:27.799381 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 599/1170] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:41:27 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 01:41:27.807682 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-928f4526-8b3f-4ea0-a352-c9ceb492907f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '.version_select at 0x7f6d24a22940>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:27.899894 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-928f4526-8b3f-4ea0-a352-c9ceb492907f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010752069" status: 204 len: 0 microversion: 2.20 time: 0.096165 Sep 03 01:41:27.900476 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 572/1171] 10.222.0.13 () {60 vars in 1262 bytes} [Sat Sep 3 01:41:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2010752069 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 03 01:41:29.997874 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-fa869059-3ddc-4ac1-8b67-4785c757ded1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:29.998403 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-fa869059-3ddc-4ac1-8b67-4785c757ded1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:30.004820 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fa869059-3ddc-4ac1-8b67-4785c757ded1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:30.005302 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fa869059-3ddc-4ac1-8b67-4785c757ded1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:30.005743 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fa869059-3ddc-4ac1-8b67-4785c757ded1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:30.006464 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fa869059-3ddc-4ac1-8b67-4785c757ded1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:30.006926 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fa869059-3ddc-4ac1-8b67-4785c757ded1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:30.007355 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-fa869059-3ddc-4ac1-8b67-4785c757ded1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:30.020616 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-fa869059-3ddc-4ac1-8b67-4785c757ded1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] HTTP exception thrown: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-fa869059-3ddc-4ac1-8b67-4785c757ded1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Request method failure captured: Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: DELETE /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 HTTP/1.1 Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7T4S5vaLoLkOelO1eKAZ94SsvgKx8nn0PlHVaKc3S3IfkHIWadTLp9Vho3tjTiMstVyv50HnZd5E16qwBjEuPO4KxgJI77i5_IhmusF5pyRLA2NqvyQ7TtQ6_6hiiIGiUeK4D5WGusqnjHzmw7njr2bwxZv5Ys82XSSEJ7DcNysls Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: e09bed4b9f9741a8ab110a2676baee7f Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:41:30.022455 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:41:30.024577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:30.024577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:30.024577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: e09bed4b9f9741a8ab110a2676baee7f Sep 03 01:41:30.024577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:30.024577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-AttachVolumeShelveTestJSON-636719635-project Sep 03 01:41:30.024577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:41:30.024577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:41:30.024577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 29b4f0836bbf4684bdc6177e42b88b20 Sep 03 01:41:30.024577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-636719635-project Sep 03 01:41:30.024577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:41:30.024577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:30.024577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': 'e156f97d-5465-4597-a836-c70692edfd41'} Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:30.025398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:30.026654 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:30.027866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-fa869059-3ddc-4ac1-8b67-4785c757ded1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Returning 404 to user: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:30.027866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-fa869059-3ddc-4ac1-8b67-4785c757ded1 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 404 len: 111 microversion: 2.20 time: 0.030441 Sep 03 01:41:30.027866 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 600/1172] 10.222.0.13 () {60 vars in 1280 bytes} [Sat Sep 3 01:41:29 2022] DELETE /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 01:41:30.033538 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a81719a3-8ef1-4918-a6b1-360835a8d68e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:30.034139 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a81719a3-8ef1-4918-a6b1-360835a8d68e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: e156f97d-5465-4597-a836-c70692edfd41] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:30.041764 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a81719a3-8ef1-4918-a6b1-360835a8d68e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:30.042239 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a81719a3-8ef1-4918-a6b1-360835a8d68e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:30.042794 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a81719a3-8ef1-4918-a6b1-360835a8d68e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:30.043473 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a81719a3-8ef1-4918-a6b1-360835a8d68e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:30.043917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a81719a3-8ef1-4918-a6b1-360835a8d68e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:30.044336 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a81719a3-8ef1-4918-a6b1-360835a8d68e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:30.057609 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-a81719a3-8ef1-4918-a6b1-360835a8d68e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] HTTP exception thrown: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a81719a3-8ef1-4918-a6b1-360835a8d68e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Request method failure captured: Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 HTTP/1.1 Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7T4S5vaLoLkOelO1eKAZ94SsvgKx8nn0PlHVaKc3S3IfkHIWadTLp9Vho3tjTiMstVyv50HnZd5E16qwBjEuPO4KxgJI77i5_IhmusF5pyRLA2NqvyQ7TtQ6_6hiiIGiUeK4D5WGusqnjHzmw7njr2bwxZv5Ys82XSSEJ7DcNysls Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: e09bed4b9f9741a8ab110a2676baee7f Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:41:30.059268 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:41:30.060917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:30.060917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:30.060917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: e09bed4b9f9741a8ab110a2676baee7f Sep 03 01:41:30.060917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:30.060917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-AttachVolumeShelveTestJSON-636719635-project Sep 03 01:41:30.060917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:41:30.060917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:41:30.060917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 29b4f0836bbf4684bdc6177e42b88b20 Sep 03 01:41:30.060917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-636719635-project Sep 03 01:41:30.060917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:41:30.060917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:30.060917 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': 'e156f97d-5465-4597-a836-c70692edfd41'} Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:30.062020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. Sep 03 01:41:30.063462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:30.065348 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a81719a3-8ef1-4918-a6b1-360835a8d68e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Returning 404 to user: Instance e156f97d-5465-4597-a836-c70692edfd41 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:30.065348 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a81719a3-8ef1-4918-a6b1-360835a8d68e tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41" status: 404 len: 111 microversion: 2.20 time: 0.031485 Sep 03 01:41:30.065348 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 573/1173] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:41:30 2022] GET /compute/v2.1/servers/e156f97d-5465-4597-a836-c70692edfd41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 01:41:31.358285 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-74aaaec4-f63a-43c5-b9e2-bfaf2b4c4e62 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:31.358822 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-74aaaec4-f63a-43c5-b9e2-bfaf2b4c4e62 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:31.365122 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74aaaec4-f63a-43c5-b9e2-bfaf2b4c4e62 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:31.365602 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74aaaec4-f63a-43c5-b9e2-bfaf2b4c4e62 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:31.366036 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74aaaec4-f63a-43c5-b9e2-bfaf2b4c4e62 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:31.366740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74aaaec4-f63a-43c5-b9e2-bfaf2b4c4e62 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:31.367194 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74aaaec4-f63a-43c5-b9e2-bfaf2b4c4e62 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:31.367611 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-74aaaec4-f63a-43c5-b9e2-bfaf2b4c4e62 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:31.381028 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-74aaaec4-f63a-43c5-b9e2-bfaf2b4c4e62 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] HTTP exception thrown: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-74aaaec4-f63a-43c5-b9e2-bfaf2b4c4e62 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Request method failure captured: Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: DELETE /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e HTTP/1.1 Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq7T4S5vaLoLkOelO1eKAZ94SsvgKx8nn0PlHVaKc3S3IfkHIWadTLp9Vho3tjTiMstVyv50HnZd5E16qwBjEuPO4KxgJI77i5_IhmusF5pyRLA2NqvyQ7TtQ6_6hiiIGiUeK4D5WGusqnjHzmw7njr2bwxZv5Ys82XSSEJ7DcNysls Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: e09bed4b9f9741a8ab110a2676baee7f Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:41:31.382586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:41:31.388207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:31.388207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:31.388207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: e09bed4b9f9741a8ab110a2676baee7f Sep 03 01:41:31.388207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:31.388207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-AttachVolumeShelveTestJSON-636719635-project Sep 03 01:41:31.388207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:41:31.388207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:41:31.388207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 29b4f0836bbf4684bdc6177e42b88b20 Sep 03 01:41:31.388207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-AttachVolumeShelveTestJSON-636719635-project Sep 03 01:41:31.388207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:41:31.388207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:41:31.388207 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '329ea656-c337-4f07-bd3d-9f67c4d6418e'} Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:31.389065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:41:31.390318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:31.391647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-74aaaec4-f63a-43c5-b9e2-bfaf2b4c4e62 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Returning 404 to user: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:31.391647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-74aaaec4-f63a-43c5-b9e2-bfaf2b4c4e62 tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "DELETE /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 404 len: 111 microversion: 2.20 time: 0.030449 Sep 03 01:41:31.391647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 601/1174] 10.222.0.13 () {60 vars in 1280 bytes} [Sat Sep 3 01:41:31 2022] DELETE /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 01:41:31.393498 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d794d9e0-5e67-4be1-bb43-9d465187f56f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:31.394113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d794d9e0-5e67-4be1-bb43-9d465187f56f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] [instance: 329ea656-c337-4f07-bd3d-9f67c4d6418e] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:41:31.401564 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d794d9e0-5e67-4be1-bb43-9d465187f56f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:31.402054 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d794d9e0-5e67-4be1-bb43-9d465187f56f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:31.402510 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d794d9e0-5e67-4be1-bb43-9d465187f56f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:31.403193 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d794d9e0-5e67-4be1-bb43-9d465187f56f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:41:31.403709 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d794d9e0-5e67-4be1-bb43-9d465187f56f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:41:31.404051 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d794d9e0-5e67-4be1-bb43-9d465187f56f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:41:31.423485 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-d794d9e0-5e67-4be1-bb43-9d465187f56f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] HTTP exception thrown: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d794d9e0-5e67-4be1-bb43-9d465187f56f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Request method failure captured: Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e HTTP/1.1 Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq7T4S5vaLoLkOelO1eKAZ94SsvgKx8nn0PlHVaKc3S3IfkHIWadTLp9Vho3tjTiMstVyv50HnZd5E16qwBjEuPO4KxgJI77i5_IhmusF5pyRLA2NqvyQ7TtQ6_6hiiIGiUeK4D5WGusqnjHzmw7njr2bwxZv5Ys82XSSEJ7DcNysls Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Openstack-Nova-Api-Version: 2.20 Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: e09bed4b9f9741a8ab110a2676baee7f Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:41:31.425036 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:41:31.426533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/e09bed4b9f9741a8ab110a2676baee7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:31.426533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:31.426533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: e09bed4b9f9741a8ab110a2676baee7f Sep 03 01:41:31.426533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-636719635 Sep 03 01:41:31.426533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-AttachVolumeShelveTestJSON-636719635-project Sep 03 01:41:31.426533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:41:31.426533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:41:31.426533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 29b4f0836bbf4684bdc6177e42b88b20 Sep 03 01:41:31.426533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-AttachVolumeShelveTestJSON-636719635-project Sep 03 01:41:31.426533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:41:31.426533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:41:31.426533 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '329ea656-c337-4f07-bd3d-9f67c4d6418e'} Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:31.427472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. Sep 03 01:41:31.428825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:31.430617 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d794d9e0-5e67-4be1-bb43-9d465187f56f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] Returning 404 to user: Instance 329ea656-c337-4f07-bd3d-9f67c4d6418e could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:31.430617 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d794d9e0-5e67-4be1-bb43-9d465187f56f tempest-AttachVolumeShelveTestJSON-636719635 tempest-AttachVolumeShelveTestJSON-636719635-project] 10.222.0.13 "GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e" status: 404 len: 111 microversion: 2.20 time: 0.037001 Sep 03 01:41:31.431399 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 574/1175] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Sep 3 01:41:31 2022] GET /compute/v2.1/servers/329ea656-c337-4f07-bd3d-9f67c4d6418e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 03 01:41:37.165425 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-34f5c6c5-9037-4311-8ab2-ca2c1a14148a tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Action: 'create', calling method: .version_select at 0x7f6d281539d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-834230012", "metadata": {"Type": "work"}}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-34f5c6c5-9037-4311-8ab2-ca2c1a14148a tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Request method failure captured: Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 121 Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjErDQfkNkwTRYTDTIGIasYmjJA_jary6d5ZbTdTKc1mIpyXBFBgywVllJWDKXG5xzj33HZc09gFZYmEp-glZ02VNz9tQ_rwVlSme6UXgO0cc52NapY1I74qzgxzkV5qWZ8LzvzuJgQN8cJVhEbt7n1EVap3p7kc-na9wgAWrJ33q4dQA Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 154b559256be4252aa82eb7c8c636f7e Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:41:37.191596 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:41:37.193310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:37.193310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.193310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 154b559256be4252aa82eb7c8c636f7e Sep 03 01:41:37.193310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.193310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-VolumesNegativeTest-1826999780-project Sep 03 01:41:37.193310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:41:37.193310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:41:37.193310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 9f3ab78a28a64eb6a7990284974eb399 Sep 03 01:41:37.193310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-VolumesNegativeTest-1826999780-project Sep 03 01:41:37.193310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Sep 03 01:41:37.193310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-834230012", "metadata": {"Type": "work"}}} Sep 03 01:41:37.193310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: Sep 03 01:41:37.193310 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-834230012', 'metadata': {'Type': 'work'}}}} Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise error Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi '#$%' Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:37.194321 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 01:41:37.196153 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 01:41:37.197395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 03 01:41:37.197395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.197395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-34f5c6c5-9037-4311-8ab2-ca2c1a14148a tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:37.197395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-34f5c6c5-9037-4311-8ab2-ca2c1a14148a tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.145593 Sep 03 01:41:37.197395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 602/1176] 10.222.0.13 () {60 vars in 1156 bytes} [Sat Sep 3 01:41:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 03 01:41:37.202861 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-38ebc1cd-93a3-4ede-b53e-9e1ae4b0203f tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Action: 'create', calling method: .version_select at 0x7f6d2496adc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1497631581", "metadata": {"Type": "work"}}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-38ebc1cd-93a3-4ede-b53e-9e1ae4b0203f tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Request method failure captured: Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 120 Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjErDQfkNkwTRYTDTIGIasYmjJA_jary6d5ZbTdTKc1mIpyXBFBgywVllJWDKXG5xzj33HZc09gFZYmEp-glZ02VNz9tQ_rwVlSme6UXgO0cc52NapY1I74qzgxzkV5qWZ8LzvzuJgQN8cJVhEbt7n1EVap3p7kc-na9wgAWrJ33q4dQA Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 154b559256be4252aa82eb7c8c636f7e Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:41:37.207378 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:41:37.209987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:37.209987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.209987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 154b559256be4252aa82eb7c8c636f7e Sep 03 01:41:37.209987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.209987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-VolumesNegativeTest-1826999780-project Sep 03 01:41:37.209987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:41:37.209987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:41:37.209987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 9f3ab78a28a64eb6a7990284974eb399 Sep 03 01:41:37.209987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-VolumesNegativeTest-1826999780-project Sep 03 01:41:37.209987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Sep 03 01:41:37.209987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1497631581", "metadata": {"Type": "work"}}} Sep 03 01:41:37.209987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: Sep 03 01:41:37.209987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1497631581', 'metadata': {'Type': 'work'}}}} Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise error Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi '0' Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:37.211052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 01:41:37.212684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 01:41:37.214200 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 03 01:41:37.214200 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.214200 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-38ebc1cd-93a3-4ede-b53e-9e1ae4b0203f tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:37.214200 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-38ebc1cd-93a3-4ede-b53e-9e1ae4b0203f tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010088 Sep 03 01:41:37.214200 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 575/1177] 10.222.0.13 () {60 vars in 1156 bytes} [Sat Sep 3 01:41:37 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 03 01:41:37.219248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-93563a15-329e-4d7f-a508-f52554b74ecb tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Action: 'create', calling method: .version_select at 0x7f6d24dcd310>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1219932071", "metadata": {"Type": "work"}}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-93563a15-329e-4d7f-a508-f52554b74ecb tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Request method failure captured: Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 119 Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjErDQfkNkwTRYTDTIGIasYmjJA_jary6d5ZbTdTKc1mIpyXBFBgywVllJWDKXG5xzj33HZc09gFZYmEp-glZ02VNz9tQ_rwVlSme6UXgO0cc52NapY1I74qzgxzkV5qWZ8LzvzuJgQN8cJVhEbt7n1EVap3p7kc-na9wgAWrJ33q4dQA Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 154b559256be4252aa82eb7c8c636f7e Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:41:37.222796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:41:37.224366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:37.224366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.224366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 154b559256be4252aa82eb7c8c636f7e Sep 03 01:41:37.224366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.224366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-VolumesNegativeTest-1826999780-project Sep 03 01:41:37.224366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:41:37.224366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:41:37.224366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 9f3ab78a28a64eb6a7990284974eb399 Sep 03 01:41:37.224366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-VolumesNegativeTest-1826999780-project Sep 03 01:41:37.224366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Sep 03 01:41:37.224366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1219932071", "metadata": {"Type": "work"}}} Sep 03 01:41:37.224366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: Sep 03 01:41:37.224366 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1219932071', 'metadata': {'Type': 'work'}}}} Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise error Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi '' Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:37.225368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 03 01:41:37.227694 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 03 01:41:37.229030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 03 01:41:37.229030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.229030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-93563a15-329e-4d7f-a508-f52554b74ecb tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:37.229030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-93563a15-329e-4d7f-a508-f52554b74ecb tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009813 Sep 03 01:41:37.229030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 603/1178] 10.222.0.13 () {60 vars in 1156 bytes} [Sat Sep 3 01:41:37 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 03 01:41:37.234782 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-fd600f0c-b503-48ad-b662-b6ddc4094ee3 tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Calling method '.version_select at 0x7f6d24a229d0>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:37.264257 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-fd600f0c-b503-48ad-b662-b6ddc4094ee3 tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] HTTP exception thrown: Volume tempest-invalid-1882616439 could not be found. Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-fd600f0c-b503-48ad-b662-b6ddc4094ee3 tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Request method failure captured: Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1882616439 HTTP/1.1 Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjErDQfkNkwTRYTDTIGIasYmjJA_jary6d5ZbTdTKc1mIpyXBFBgywVllJWDKXG5xzj33HZc09gFZYmEp-glZ02VNz9tQ_rwVlSme6UXgO0cc52NapY1I74qzgxzkV5qWZ8LzvzuJgQN8cJVhEbt7n1EVap3p7kc-na9wgAWrJ33q4dQA Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 154b559256be4252aa82eb7c8c636f7e Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:41:37.266374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:41:37.268017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:37.268017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.268017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 154b559256be4252aa82eb7c8c636f7e Sep 03 01:41:37.268017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.268017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-VolumesNegativeTest-1826999780-project Sep 03 01:41:37.268017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:41:37.268017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:41:37.268017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 9f3ab78a28a64eb6a7990284974eb399 Sep 03 01:41:37.268017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-VolumesNegativeTest-1826999780-project Sep 03 01:41:37.268017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: Sep 03 01:41:37.268017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Volume tempest-invalid-1882616439 could not be found. Sep 03 01:41:37.268017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': 'tempest-invalid-1882616439'} Sep 03 01:41:37.268017 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1882616439 could not be found. (HTTP 404) (Request-ID: req-a5ca0e1b-865a-461a-a4e8-8b20b1cb7349) Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.272980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 01:41:37.275082 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1882616439 could not be found. Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:37.276569 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1882616439 could not be found. Sep 03 01:41:37.278055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.278055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.278055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.278055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.278055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:37.278055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:37.278055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:37.278055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:37.278055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1882616439 could not be found. Sep 03 01:41:37.278055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.278055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-fd600f0c-b503-48ad-b662-b6ddc4094ee3 tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Returning 404 to user: Volume tempest-invalid-1882616439 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:37.278055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-fd600f0c-b503-48ad-b662-b6ddc4094ee3 tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1882616439" status: 404 len: 99 microversion: 2.1 time: 0.037228 Sep 03 01:41:37.278055 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 576/1179] 10.222.0.13 () {58 vars in 1218 bytes} [Sat Sep 3 01:41:37 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1882616439 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 03 01:41:37.279600 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-60e2c5c8-4d5f-4f97-a8b0-f08898d51da1 tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005488 Sep 03 01:41:37.280106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 604/1180] 10.222.0.13 () {58 vars in 1140 bytes} [Sat Sep 3 01:41:37 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 03 01:41:37.289703 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-8a59eb24-3a79-477e-ab3f-45691a2c0450 tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003836 Sep 03 01:41:37.290221 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 577/1181] 10.222.0.13 () {58 vars in 1137 bytes} [Sat Sep 3 01:41:37 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 03 01:41:37.299030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c1bc9b7c-f29f-42e0-96da-442ccfbf9985 tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Calling method '.version_select at 0x7f6d2808db80>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:37.327783 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-c1bc9b7c-f29f-42e0-96da-442ccfbf9985 tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] HTTP exception thrown: Volume 74bd9ebe-d0ce-4da9-a7ee-ebb509a9dfd1 could not be found. Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c1bc9b7c-f29f-42e0-96da-442ccfbf9985 tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Request method failure captured: Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: DELETE /compute/v2.1/os-volumes/74bd9ebe-d0ce-4da9-a7ee-ebb509a9dfd1 HTTP/1.1 Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjErDQfkNkwTRYTDTIGIasYmjJA_jary6d5ZbTdTKc1mIpyXBFBgywVllJWDKXG5xzj33HZc09gFZYmEp-glZ02VNz9tQ_rwVlSme6UXgO0cc52NapY1I74qzgxzkV5qWZ8LzvzuJgQN8cJVhEbt7n1EVap3p7kc-na9wgAWrJ33q4dQA Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 154b559256be4252aa82eb7c8c636f7e Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:41:37.329993 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:41:37.331729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:37.331729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.331729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 154b559256be4252aa82eb7c8c636f7e Sep 03 01:41:37.331729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.331729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-VolumesNegativeTest-1826999780-project Sep 03 01:41:37.331729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:41:37.331729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:41:37.331729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 9f3ab78a28a64eb6a7990284974eb399 Sep 03 01:41:37.331729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-VolumesNegativeTest-1826999780-project Sep 03 01:41:37.331729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: Sep 03 01:41:37.331729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Volume 74bd9ebe-d0ce-4da9-a7ee-ebb509a9dfd1 could not be found. Sep 03 01:41:37.331729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '74bd9ebe-d0ce-4da9-a7ee-ebb509a9dfd1'} Sep 03 01:41:37.331729 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 74bd9ebe-d0ce-4da9-a7ee-ebb509a9dfd1 could not be found. (HTTP 404) (Request-ID: req-49d78ac0-e2cb-4232-9fce-50d41b300627) Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.332842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 03 01:41:37.334292 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 74bd9ebe-d0ce-4da9-a7ee-ebb509a9dfd1 could not be found. Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 03 01:41:37.338198 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 74bd9ebe-d0ce-4da9-a7ee-ebb509a9dfd1 could not be found. Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 74bd9ebe-d0ce-4da9-a7ee-ebb509a9dfd1 could not be found. Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c1bc9b7c-f29f-42e0-96da-442ccfbf9985 tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Returning 404 to user: Volume 74bd9ebe-d0ce-4da9-a7ee-ebb509a9dfd1 could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c1bc9b7c-f29f-42e0-96da-442ccfbf9985 tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/74bd9ebe-d0ce-4da9-a7ee-ebb509a9dfd1" status: 404 len: 109 microversion: 2.1 time: 0.036310 Sep 03 01:41:37.339763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 605/1182] 10.222.0.13 () {58 vars in 1248 bytes} [Sat Sep 3 01:41:37 2022] DELETE /compute/v2.1/os-volumes/74bd9ebe-d0ce-4da9-a7ee-ebb509a9dfd1 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:41:37.345762 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e49f5f30-3422-4127-a6e8-16cddbcf884e tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Calling method '.version_select at 0x7f6d249ca310>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:41:37.374404 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-e49f5f30-3422-4127-a6e8-16cddbcf884e tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] HTTP exception thrown: Volume a300a573-e262-4b79-8ac9-f8ebeb7b7e38 could not be found. Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e49f5f30-3422-4127-a6e8-16cddbcf884e tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Request method failure captured: Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/os-volumes/a300a573-e262-4b79-8ac9-f8ebeb7b7e38 HTTP/1.1 Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjErDQfkNkwTRYTDTIGIasYmjJA_jary6d5ZbTdTKc1mIpyXBFBgywVllJWDKXG5xzj33HZc09gFZYmEp-glZ02VNz9tQ_rwVlSme6UXgO0cc52NapY1I74qzgxzkV5qWZ8LzvzuJgQN8cJVhEbt7n1EVap3p7kc-na9wgAWrJ33q4dQA Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 154b559256be4252aa82eb7c8c636f7e Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:41:37.376365 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:41:37.377993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/154b559256be4252aa82eb7c8c636f7e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:41:37.377993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.377993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 154b559256be4252aa82eb7c8c636f7e Sep 03 01:41:37.377993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-VolumesNegativeTest-1826999780 Sep 03 01:41:37.377993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-VolumesNegativeTest-1826999780-project Sep 03 01:41:37.377993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:41:37.377993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:41:37.377993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 9f3ab78a28a64eb6a7990284974eb399 Sep 03 01:41:37.377993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-VolumesNegativeTest-1826999780-project Sep 03 01:41:37.377993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: Sep 03 01:41:37.377993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Volume a300a573-e262-4b79-8ac9-f8ebeb7b7e38 could not be found. Sep 03 01:41:37.377993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': 'a300a573-e262-4b79-8ac9-f8ebeb7b7e38'} Sep 03 01:41:37.377993 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a300a573-e262-4b79-8ac9-f8ebeb7b7e38 could not be found. (HTTP 404) (Request-ID: req-55ef9738-cf5d-4575-8121-567a35922a82) Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.378977 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 03 01:41:37.380430 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a300a573-e262-4b79-8ac9-f8ebeb7b7e38 could not be found. Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 03 01:41:37.381809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a300a573-e262-4b79-8ac9-f8ebeb7b7e38 could not be found. Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a300a573-e262-4b79-8ac9-f8ebeb7b7e38 could not be found. Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e49f5f30-3422-4127-a6e8-16cddbcf884e tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] Returning 404 to user: Volume a300a573-e262-4b79-8ac9-f8ebeb7b7e38 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e49f5f30-3422-4127-a6e8-16cddbcf884e tempest-VolumesNegativeTest-1826999780 tempest-VolumesNegativeTest-1826999780-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/a300a573-e262-4b79-8ac9-f8ebeb7b7e38" status: 404 len: 109 microversion: 2.1 time: 0.035966 Sep 03 01:41:37.383287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 578/1183] 10.222.0.13 () {58 vars in 1245 bytes} [Sat Sep 3 01:41:37 2022] GET /compute/v2.1/os-volumes/a300a573-e262-4b79-8ac9-f8ebeb7b7e38 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:42:50.738702 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR oslo.messaging._drivers.impl_rabbit [-] [9fac7c57-f11c-4351-8744-635b2410b717] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 01:42:50.739130 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=14 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:42:50.739855 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=26 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:42:50.744595 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-56057036", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-467180834", "security_groups": [{"name": "tempest-secgroup-smoke-1200131279"}], "block_device_mapping_v2": [{"uuid": "b3d46afb-84e9-4567-acf1-94c02dc2dcc0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "acc3f9d7-e89e-4ae5-bc90-4373dd60425f"}]}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:42:50.862252 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.network.neutron [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] validate_networks() for [('acc3f9d7-e89e-4ae5-bc90-4373dd60425f', None, None, None, None, None)] {{(pid=127552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:42:51.513214 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Flavor limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:42:51.513740 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Image limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:42:51.514678 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Flavor pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:42:51.515226 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Image pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:42:51.515659 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:42:51.524550 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:51.525056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:51.525613 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:51.526368 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:51.526909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:51.527284 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:51.545104 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Getting quotas for project c306d09e93584320b34697dba7641ac8. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:42:51.549180 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Getting quotas for user df0ffa9f450642cc94ed828cb34034b5 and project c306d09e93584320b34697dba7641ac8. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:42:51.607944 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Going to run 1 instances... {{(pid=127552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:42:51.610724 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b3d46afb-84e9-4567-acf1-94c02dc2dcc0',volume_size=None,volume_type=None)] {{(pid=127552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:42:51.746957 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO oslo.messaging._drivers.impl_rabbit [-] [9fac7c57-f11c-4351-8744-635b2410b717] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 53612. Sep 03 01:42:52.088822 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-64f257ae-59c3-477a-9c38-eb35988856ec tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.352497 Sep 03 01:42:52.096127 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 606/1184] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:42:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:42:52.099442 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:42:52.100503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:42:52.105749 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-bba04704-88b6-4a54-aed5-d7ad5d6b3ad4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:42:52.108732 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-bba04704-88b6-4a54-aed5-d7ad5d6b3ad4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:42:52.166241 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-bba04704-88b6-4a54-aed5-d7ad5d6b3ad4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:42:52.174612 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-bba04704-88b6-4a54-aed5-d7ad5d6b3ad4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1092 microversion: 2.1 time: 0.077059 Sep 03 01:42:52.175795 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 579/1185] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:42:52 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1092 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:42:53.197492 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-003b5a5c-f4f9-4ae8-aa45-6d94fe6a2b0b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:42:53.198136 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-003b5a5c-f4f9-4ae8-aa45-6d94fe6a2b0b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:42:53.205394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-003b5a5c-f4f9-4ae8-aa45-6d94fe6a2b0b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:53.205870 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-003b5a5c-f4f9-4ae8-aa45-6d94fe6a2b0b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:53.206305 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-003b5a5c-f4f9-4ae8-aa45-6d94fe6a2b0b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:53.207004 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-003b5a5c-f4f9-4ae8-aa45-6d94fe6a2b0b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:53.207456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-003b5a5c-f4f9-4ae8-aa45-6d94fe6a2b0b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:53.207873 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-003b5a5c-f4f9-4ae8-aa45-6d94fe6a2b0b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:53.269034 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-003b5a5c-f4f9-4ae8-aa45-6d94fe6a2b0b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:42:53.277113 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-003b5a5c-f4f9-4ae8-aa45-6d94fe6a2b0b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1142 microversion: 2.1 time: 0.083976 Sep 03 01:42:53.281514 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 607/1186] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:42:53 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1142 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:42:54.093510 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-316659433", "imageRef": "8accf323-657c-4b3e-9ce0-8c5761a64b93", "flavorRef": "452"}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:42:54.300911 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-439ecb55-068f-464e-a485-01f59c4dff58 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:42:54.301528 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-439ecb55-068f-464e-a485-01f59c4dff58 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:42:54.307372 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.network.neutron [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] validate_networks() for None {{(pid=127553) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:42:54.307746 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-439ecb55-068f-464e-a485-01f59c4dff58 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:54.308228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-439ecb55-068f-464e-a485-01f59c4dff58 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:54.308664 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-439ecb55-068f-464e-a485-01f59c4dff58 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:54.309354 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-439ecb55-068f-464e-a485-01f59c4dff58 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:54.309807 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-439ecb55-068f-464e-a485-01f59c4dff58 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:54.310240 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-439ecb55-068f-464e-a485-01f59c4dff58 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:54.378279 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-439ecb55-068f-464e-a485-01f59c4dff58 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:42:54.386117 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-439ecb55-068f-464e-a485-01f59c4dff58 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1190 microversion: 2.1 time: 0.089013 Sep 03 01:42:54.386803 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 608/1187] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:42:54 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1190 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:42:54.586527 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Flavor limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:42:54.586979 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Image limits 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:42:54.587452 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Flavor pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:42:54.588030 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Image pref 0:0:0 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:42:54.588350 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.virt.hardware [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127553) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:42:54.598892 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:54.599376 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:54.599813 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:54.600539 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:54.600996 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:54.601420 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:54.621148 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Getting quotas for project 53d6048fb19e4828a58b35024ced4518. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:42:54.626286 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Getting quotas for user 7f3ca49df57440c0895389872f144036 and project 53d6048fb19e4828a58b35024ced4518. Resources: {'instances', 'ram', 'cores'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:42:54.637540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Going to run 1 instances... {{(pid=127553) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:42:54.639931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8accf323-657c-4b3e-9ce0-8c5761a64b93',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127553) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:42:54.776511 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [6040fca8-d285-4575-931a-b412ee9df3ba] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 01:42:55.409765 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-aa3bf10d-2619-44d4-a776-a3782dc38c55 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:42:55.410678 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-aa3bf10d-2619-44d4-a776-a3782dc38c55 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:42:55.417430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aa3bf10d-2619-44d4-a776-a3782dc38c55 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:55.418871 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aa3bf10d-2619-44d4-a776-a3782dc38c55 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:55.418871 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aa3bf10d-2619-44d4-a776-a3782dc38c55 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:55.419099 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aa3bf10d-2619-44d4-a776-a3782dc38c55 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:55.419574 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aa3bf10d-2619-44d4-a776-a3782dc38c55 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:55.420015 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-aa3bf10d-2619-44d4-a776-a3782dc38c55 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:55.741048 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-aa3bf10d-2619-44d4-a776-a3782dc38c55 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:42:55.749421 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-aa3bf10d-2619-44d4-a776-a3782dc38c55 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1276 microversion: 2.1 time: 0.343512 Sep 03 01:42:55.751763 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 609/1188] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:42:55 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1276 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:42:55.785514 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO oslo.messaging._drivers.impl_rabbit [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [6040fca8-d285-4575-931a-b412ee9df3ba] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 53670. Sep 03 01:42:55.790307 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a63f755d-b82a-4b1c-a9c4-2aeb33e52e4b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.701328 Sep 03 01:42:55.791595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 580/1189] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:42:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:42:55.803103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-40f53e26-8c7b-46a5-8ac7-4f6e4b4e3234 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:42:55.803841 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-40f53e26-8c7b-46a5-8ac7-4f6e4b4e3234 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:42:55.866668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-40f53e26-8c7b-46a5-8ac7-4f6e4b4e3234 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:42:55.874456 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-40f53e26-8c7b-46a5-8ac7-4f6e4b4e3234 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1214 microversion: 2.1 time: 0.075423 Sep 03 01:42:55.890674 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 610/1190] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:42:55 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:42:56.407435 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-e5c536d3-8f0c-4c05-a0af-321c0cba6f7c req-ae42c9d9-966b-4cb4-a344-ae2efd9d8736 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eabe504-22f6-43b9-bc56-a312814d450f", "tag": "a7b84cbd-9e1d-4379-a29a-842372c152b3"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:42:56.419506 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-e5c536d3-8f0c-4c05-a0af-321c0cba6f7c req-ae42c9d9-966b-4cb4-a344-ae2efd9d8736 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:56.419506 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-e5c536d3-8f0c-4c05-a0af-321c0cba6f7c req-ae42c9d9-966b-4cb4-a344-ae2efd9d8736 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:56.419506 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-e5c536d3-8f0c-4c05-a0af-321c0cba6f7c req-ae42c9d9-966b-4cb4-a344-ae2efd9d8736 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:56.431314 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-e5c536d3-8f0c-4c05-a0af-321c0cba6f7c req-ae42c9d9-966b-4cb4-a344-ae2efd9d8736 service nova] Creating event network-changed:a7b84cbd-9e1d-4379-a29a-842372c152b3 for instance 4eabe504-22f6-43b9-bc56-a312814d450f on hv-cinder-83800 Sep 03 01:42:56.436633 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-e5c536d3-8f0c-4c05-a0af-321c0cba6f7c req-ae42c9d9-966b-4cb4-a344-ae2efd9d8736 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034542 Sep 03 01:42:56.438157 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 581/1191] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:42:56.773061 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ed130074-5850-4556-9305-415ff152834b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:42:56.774360 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ed130074-5850-4556-9305-415ff152834b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:42:56.782019 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed130074-5850-4556-9305-415ff152834b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:56.782544 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed130074-5850-4556-9305-415ff152834b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:56.782979 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed130074-5850-4556-9305-415ff152834b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:56.783671 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed130074-5850-4556-9305-415ff152834b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:56.784117 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed130074-5850-4556-9305-415ff152834b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:56.784536 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ed130074-5850-4556-9305-415ff152834b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:56.897570 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e8bbd1fc-17c1-449f-a97c-39ed9a4fa813 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:42:56.898265 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e8bbd1fc-17c1-449f-a97c-39ed9a4fa813 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:42:56.958063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e8bbd1fc-17c1-449f-a97c-39ed9a4fa813 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:42:56.965837 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e8bbd1fc-17c1-449f-a97c-39ed9a4fa813 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1214 microversion: 2.1 time: 0.071797 Sep 03 01:42:56.965837 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 582/1192] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:42:56 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:42:56.995129 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-ed130074-5850-4556-9305-415ff152834b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:42:57.004296 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ed130074-5850-4556-9305-415ff152834b tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1264 microversion: 2.1 time: 0.235127 Sep 03 01:42:57.004989 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 611/1193] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:42:56 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1264 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:42:57.989231 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-236a0769-4add-4dd3-b2e5-ad20ec9d92a1 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:42:57.989756 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-236a0769-4add-4dd3-b2e5-ad20ec9d92a1 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:42:57.998273 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-236a0769-4add-4dd3-b2e5-ad20ec9d92a1 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:57.998614 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-236a0769-4add-4dd3-b2e5-ad20ec9d92a1 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:57.999048 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-236a0769-4add-4dd3-b2e5-ad20ec9d92a1 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:57.999741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-236a0769-4add-4dd3-b2e5-ad20ec9d92a1 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:58.000190 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-236a0769-4add-4dd3-b2e5-ad20ec9d92a1 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:58.000608 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-236a0769-4add-4dd3-b2e5-ad20ec9d92a1 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:58.030954 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c5b08275-b64c-464f-a439-a3c2d5f62eea tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:42:58.032281 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c5b08275-b64c-464f-a439-a3c2d5f62eea tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:42:58.039411 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c5b08275-b64c-464f-a439-a3c2d5f62eea tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:58.040109 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c5b08275-b64c-464f-a439-a3c2d5f62eea tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:58.040807 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c5b08275-b64c-464f-a439-a3c2d5f62eea tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:58.041682 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c5b08275-b64c-464f-a439-a3c2d5f62eea tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:58.042413 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c5b08275-b64c-464f-a439-a3c2d5f62eea tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:58.043178 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c5b08275-b64c-464f-a439-a3c2d5f62eea tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:58.067724 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-236a0769-4add-4dd3-b2e5-ad20ec9d92a1 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:42:58.075786 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-236a0769-4add-4dd3-b2e5-ad20ec9d92a1 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1266 microversion: 2.1 time: 0.090367 Sep 03 01:42:58.077258 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 583/1194] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:42:57 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:42:58.177643 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c5b08275-b64c-464f-a439-a3c2d5f62eea tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:42:58.185738 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c5b08275-b64c-464f-a439-a3c2d5f62eea tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1264 microversion: 2.1 time: 0.158019 Sep 03 01:42:58.186298 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 612/1195] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:42:58 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:42:59.100540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a05159e8-d574-4f82-9089-672cccc4fcb8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:42:59.101088 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a05159e8-d574-4f82-9089-672cccc4fcb8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:42:59.108474 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a05159e8-d574-4f82-9089-672cccc4fcb8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:59.109026 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a05159e8-d574-4f82-9089-672cccc4fcb8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:59.109461 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a05159e8-d574-4f82-9089-672cccc4fcb8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:59.110150 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a05159e8-d574-4f82-9089-672cccc4fcb8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:59.110646 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a05159e8-d574-4f82-9089-672cccc4fcb8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:59.111063 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a05159e8-d574-4f82-9089-672cccc4fcb8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:59.175676 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a05159e8-d574-4f82-9089-672cccc4fcb8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:42:59.184290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a05159e8-d574-4f82-9089-672cccc4fcb8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1272 microversion: 2.1 time: 0.087744 Sep 03 01:42:59.185812 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 584/1196] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:42:59 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:42:59.208157 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-57639988-ee5a-4d55-b041-227e4330ce91 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:42:59.208767 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-57639988-ee5a-4d55-b041-227e4330ce91 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:42:59.215291 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57639988-ee5a-4d55-b041-227e4330ce91 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:59.215769 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57639988-ee5a-4d55-b041-227e4330ce91 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:59.216323 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57639988-ee5a-4d55-b041-227e4330ce91 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:59.217517 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57639988-ee5a-4d55-b041-227e4330ce91 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:42:59.218141 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57639988-ee5a-4d55-b041-227e4330ce91 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:42:59.218594 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-57639988-ee5a-4d55-b041-227e4330ce91 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:42:59.432013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-57639988-ee5a-4d55-b041-227e4330ce91 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:42:59.440445 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-57639988-ee5a-4d55-b041-227e4330ce91 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1264 microversion: 2.1 time: 0.236224 Sep 03 01:42:59.441014 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 613/1197] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:42:59 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:00.211213 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a2e7a4ef-09b2-41ca-9e5e-2c4a615695ec tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:00.211810 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a2e7a4ef-09b2-41ca-9e5e-2c4a615695ec tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:00.218151 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2e7a4ef-09b2-41ca-9e5e-2c4a615695ec tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:00.218663 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2e7a4ef-09b2-41ca-9e5e-2c4a615695ec tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:00.219095 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2e7a4ef-09b2-41ca-9e5e-2c4a615695ec tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:00.219774 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2e7a4ef-09b2-41ca-9e5e-2c4a615695ec tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:00.220226 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2e7a4ef-09b2-41ca-9e5e-2c4a615695ec tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:00.220645 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2e7a4ef-09b2-41ca-9e5e-2c4a615695ec tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:00.352788 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a2e7a4ef-09b2-41ca-9e5e-2c4a615695ec tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:00.361304 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a2e7a4ef-09b2-41ca-9e5e-2c4a615695ec tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1314 microversion: 2.1 time: 0.153974 Sep 03 01:43:00.362168 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 585/1198] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:00 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:00.463819 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-181b79b1-dc3f-4ee6-b415-c87ad5a55bed tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:00.464624 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-181b79b1-dc3f-4ee6-b415-c87ad5a55bed tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:00.471526 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-181b79b1-dc3f-4ee6-b415-c87ad5a55bed tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:00.472036 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-181b79b1-dc3f-4ee6-b415-c87ad5a55bed tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:00.472464 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-181b79b1-dc3f-4ee6-b415-c87ad5a55bed tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:00.473146 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-181b79b1-dc3f-4ee6-b415-c87ad5a55bed tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:00.473593 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-181b79b1-dc3f-4ee6-b415-c87ad5a55bed tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:00.474010 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-181b79b1-dc3f-4ee6-b415-c87ad5a55bed tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:00.596856 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-c15eaef1-5633-4db2-832a-35e8077a187e req-2839f383-45de-46f6-81ef-dc784f104ebe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8a534200-13b1-4b2d-8bfa-1ed15e39465b", "tag": "96eedadc-2aa0-43e2-b228-d2faf31c150b"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:43:00.606499 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-c15eaef1-5633-4db2-832a-35e8077a187e req-2839f383-45de-46f6-81ef-dc784f104ebe service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:00.606923 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-c15eaef1-5633-4db2-832a-35e8077a187e req-2839f383-45de-46f6-81ef-dc784f104ebe service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:00.607692 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-c15eaef1-5633-4db2-832a-35e8077a187e req-2839f383-45de-46f6-81ef-dc784f104ebe service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:00.618459 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-c15eaef1-5633-4db2-832a-35e8077a187e req-2839f383-45de-46f6-81ef-dc784f104ebe service nova] Creating event network-changed:96eedadc-2aa0-43e2-b228-d2faf31c150b for instance 8a534200-13b1-4b2d-8bfa-1ed15e39465b on hv-cinder-83800 Sep 03 01:43:00.623341 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-c15eaef1-5633-4db2-832a-35e8077a187e req-2839f383-45de-46f6-81ef-dc784f104ebe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030056 Sep 03 01:43:00.624170 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 586/1199] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:43:00.670125 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-181b79b1-dc3f-4ee6-b415-c87ad5a55bed tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:00.678314 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-181b79b1-dc3f-4ee6-b415-c87ad5a55bed tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1264 microversion: 2.1 time: 0.218310 Sep 03 01:43:00.679268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 614/1200] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:00 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1264 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:01.385336 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2b693025-6107-456d-b09d-18963581013a tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:01.386040 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2b693025-6107-456d-b09d-18963581013a tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:01.392638 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b693025-6107-456d-b09d-18963581013a tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:01.393132 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b693025-6107-456d-b09d-18963581013a tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:01.393575 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b693025-6107-456d-b09d-18963581013a tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:01.394272 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b693025-6107-456d-b09d-18963581013a tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:01.394757 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b693025-6107-456d-b09d-18963581013a tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:01.395188 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2b693025-6107-456d-b09d-18963581013a tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:01.524684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2b693025-6107-456d-b09d-18963581013a tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:01.532224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2b693025-6107-456d-b09d-18963581013a tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1314 microversion: 2.1 time: 0.151628 Sep 03 01:43:01.532781 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 587/1201] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:01 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:01.700954 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-0db65124-9469-48b8-b846-5c6ba5ce68da tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:01.701562 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-0db65124-9469-48b8-b846-5c6ba5ce68da tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:01.703880 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:43:01.708592 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0db65124-9469-48b8-b846-5c6ba5ce68da tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:01.709071 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0db65124-9469-48b8-b846-5c6ba5ce68da tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:01.709497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0db65124-9469-48b8-b846-5c6ba5ce68da tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:01.710173 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0db65124-9469-48b8-b846-5c6ba5ce68da tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:01.710645 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0db65124-9469-48b8-b846-5c6ba5ce68da tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:01.713960 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-0db65124-9469-48b8-b846-5c6ba5ce68da tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:01.845362 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-0db65124-9469-48b8-b846-5c6ba5ce68da tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:01.853429 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-0db65124-9469-48b8-b846-5c6ba5ce68da tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1264 microversion: 2.1 time: 0.156457 Sep 03 01:43:01.854005 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 615/1202] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:01 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:02.555876 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-cae9f9cf-51b8-4fc1-9d41-0869546ce007 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:02.556523 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-cae9f9cf-51b8-4fc1-9d41-0869546ce007 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:02.564104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cae9f9cf-51b8-4fc1-9d41-0869546ce007 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:02.564960 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cae9f9cf-51b8-4fc1-9d41-0869546ce007 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:02.565512 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cae9f9cf-51b8-4fc1-9d41-0869546ce007 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:02.566792 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cae9f9cf-51b8-4fc1-9d41-0869546ce007 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:02.567618 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cae9f9cf-51b8-4fc1-9d41-0869546ce007 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:02.568230 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-cae9f9cf-51b8-4fc1-9d41-0869546ce007 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:02.700563 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-cae9f9cf-51b8-4fc1-9d41-0869546ce007 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:02.708800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-cae9f9cf-51b8-4fc1-9d41-0869546ce007 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1314 microversion: 2.1 time: 0.156828 Sep 03 01:43:02.709369 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 588/1203] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:02 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:02.877980 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-52735d04-618d-4a92-890c-8f040bdd244f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:02.878685 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-52735d04-618d-4a92-890c-8f040bdd244f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:02.885081 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-52735d04-618d-4a92-890c-8f040bdd244f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:02.885560 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-52735d04-618d-4a92-890c-8f040bdd244f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:02.885999 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-52735d04-618d-4a92-890c-8f040bdd244f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:02.886717 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-52735d04-618d-4a92-890c-8f040bdd244f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:02.887170 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-52735d04-618d-4a92-890c-8f040bdd244f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:02.887592 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-52735d04-618d-4a92-890c-8f040bdd244f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:03.025354 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-52735d04-618d-4a92-890c-8f040bdd244f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:03.033147 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-52735d04-618d-4a92-890c-8f040bdd244f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1264 microversion: 2.1 time: 0.159056 Sep 03 01:43:03.033712 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 616/1204] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:02 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:03.732905 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e5c4bef8-a586-4667-a6b3-d82d0b806cdc tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:03.733526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e5c4bef8-a586-4667-a6b3-d82d0b806cdc tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:03.740135 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e5c4bef8-a586-4667-a6b3-d82d0b806cdc tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:03.740622 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e5c4bef8-a586-4667-a6b3-d82d0b806cdc tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:03.741054 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e5c4bef8-a586-4667-a6b3-d82d0b806cdc tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:03.741793 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e5c4bef8-a586-4667-a6b3-d82d0b806cdc tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:03.742242 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e5c4bef8-a586-4667-a6b3-d82d0b806cdc tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:03.742690 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e5c4bef8-a586-4667-a6b3-d82d0b806cdc tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:03.873762 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e5c4bef8-a586-4667-a6b3-d82d0b806cdc tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:03.881346 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e5c4bef8-a586-4667-a6b3-d82d0b806cdc tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1314 microversion: 2.1 time: 0.152673 Sep 03 01:43:03.881949 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 589/1205] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:03 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:04.056520 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-f6df9552-488c-4cc2-a28f-f64bb1ecc3bb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:04.057125 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-f6df9552-488c-4cc2-a28f-f64bb1ecc3bb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:04.063534 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f6df9552-488c-4cc2-a28f-f64bb1ecc3bb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:04.064007 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f6df9552-488c-4cc2-a28f-f64bb1ecc3bb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:04.064433 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f6df9552-488c-4cc2-a28f-f64bb1ecc3bb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:04.065111 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f6df9552-488c-4cc2-a28f-f64bb1ecc3bb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:04.065555 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f6df9552-488c-4cc2-a28f-f64bb1ecc3bb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:04.065972 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-f6df9552-488c-4cc2-a28f-f64bb1ecc3bb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:04.198013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-f6df9552-488c-4cc2-a28f-f64bb1ecc3bb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:04.205699 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-f6df9552-488c-4cc2-a28f-f64bb1ecc3bb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1264 microversion: 2.1 time: 0.153110 Sep 03 01:43:04.206262 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 617/1206] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:04 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:04.878931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-8e2d9372-9ce5-4a01-b993-1c8af3e55200 req-641b761d-8597-413a-aae7-624be9c804dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a534200-13b1-4b2d-8bfa-1ed15e39465b", "name": "network-vif-plugged", "status": "completed", "tag": "96eedadc-2aa0-43e2-b228-d2faf31c150b"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:43:04.884670 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:43:04.890634 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-8e2d9372-9ce5-4a01-b993-1c8af3e55200 req-641b761d-8597-413a-aae7-624be9c804dd service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:04.891129 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-8e2d9372-9ce5-4a01-b993-1c8af3e55200 req-641b761d-8597-413a-aae7-624be9c804dd service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:04.891545 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-8e2d9372-9ce5-4a01-b993-1c8af3e55200 req-641b761d-8597-413a-aae7-624be9c804dd service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:04.902920 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-8e2d9372-9ce5-4a01-b993-1c8af3e55200 req-641b761d-8597-413a-aae7-624be9c804dd service nova] Creating event network-vif-plugged:96eedadc-2aa0-43e2-b228-d2faf31c150b for instance 8a534200-13b1-4b2d-8bfa-1ed15e39465b on hv-cinder-83800 Sep 03 01:43:04.904394 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-1a2850e9-29c5-48bc-9960-c7d7d2b1c5f0 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:04.905179 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-1a2850e9-29c5-48bc-9960-c7d7d2b1c5f0 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:04.908022 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-8e2d9372-9ce5-4a01-b993-1c8af3e55200 req-641b761d-8597-413a-aae7-624be9c804dd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033087 Sep 03 01:43:04.908763 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 590/1207] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:43:04.913113 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1a2850e9-29c5-48bc-9960-c7d7d2b1c5f0 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:04.913622 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1a2850e9-29c5-48bc-9960-c7d7d2b1c5f0 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:04.914060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1a2850e9-29c5-48bc-9960-c7d7d2b1c5f0 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:04.914797 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1a2850e9-29c5-48bc-9960-c7d7d2b1c5f0 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:04.915254 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1a2850e9-29c5-48bc-9960-c7d7d2b1c5f0 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:04.915736 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-1a2850e9-29c5-48bc-9960-c7d7d2b1c5f0 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:05.049972 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-1a2850e9-29c5-48bc-9960-c7d7d2b1c5f0 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:05.058704 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-1a2850e9-29c5-48bc-9960-c7d7d2b1c5f0 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1314 microversion: 2.1 time: 0.158168 Sep 03 01:43:05.060852 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 618/1208] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:04 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:43:05.230150 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7fca1e6c-844e-416b-a873-de09dde857a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:05.231129 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7fca1e6c-844e-416b-a873-de09dde857a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:05.239096 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7fca1e6c-844e-416b-a873-de09dde857a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:05.239711 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7fca1e6c-844e-416b-a873-de09dde857a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:05.240438 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7fca1e6c-844e-416b-a873-de09dde857a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:05.241689 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7fca1e6c-844e-416b-a873-de09dde857a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:05.241911 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7fca1e6c-844e-416b-a873-de09dde857a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:05.242619 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7fca1e6c-844e-416b-a873-de09dde857a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:05.380359 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7fca1e6c-844e-416b-a873-de09dde857a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:05.388048 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7fca1e6c-844e-416b-a873-de09dde857a4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1264 microversion: 2.1 time: 0.162526 Sep 03 01:43:05.388618 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 591/1209] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:05 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:06.083879 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-8df6405e-f676-4623-8553-973adc13082b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:06.084480 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-8df6405e-f676-4623-8553-973adc13082b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:06.086904 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=8 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:43:06.091643 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8df6405e-f676-4623-8553-973adc13082b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:06.092827 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8df6405e-f676-4623-8553-973adc13082b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:06.093255 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8df6405e-f676-4623-8553-973adc13082b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:06.093938 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8df6405e-f676-4623-8553-973adc13082b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:06.094450 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8df6405e-f676-4623-8553-973adc13082b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:06.094869 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-8df6405e-f676-4623-8553-973adc13082b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:06.222401 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-8df6405e-f676-4623-8553-973adc13082b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:06.230075 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-8df6405e-f676-4623-8553-973adc13082b tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1314 microversion: 2.1 time: 0.150002 Sep 03 01:43:06.230686 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 619/1210] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:06 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:06.411191 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-03679353-1d3b-4bbb-925e-0cc071091c0f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:06.411799 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-03679353-1d3b-4bbb-925e-0cc071091c0f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:06.418186 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-03679353-1d3b-4bbb-925e-0cc071091c0f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:06.418694 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-03679353-1d3b-4bbb-925e-0cc071091c0f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:06.419125 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-03679353-1d3b-4bbb-925e-0cc071091c0f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:06.419808 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-03679353-1d3b-4bbb-925e-0cc071091c0f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:06.420288 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-03679353-1d3b-4bbb-925e-0cc071091c0f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:06.420793 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-03679353-1d3b-4bbb-925e-0cc071091c0f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:06.558903 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-03679353-1d3b-4bbb-925e-0cc071091c0f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:06.567374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-03679353-1d3b-4bbb-925e-0cc071091c0f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1264 microversion: 2.1 time: 0.160284 Sep 03 01:43:06.567950 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 592/1211] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:06 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:06.932280 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-412dbd7d-96d8-476b-82f1-9bfaf2ea05b1 req-6ddac53a-1dcb-47ee-9afb-04b56e2c519f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eabe504-22f6-43b9-bc56-a312814d450f", "name": "network-vif-plugged", "status": "completed", "tag": "a7b84cbd-9e1d-4379-a29a-842372c152b3"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:43:06.942152 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-412dbd7d-96d8-476b-82f1-9bfaf2ea05b1 req-6ddac53a-1dcb-47ee-9afb-04b56e2c519f service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:06.942668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-412dbd7d-96d8-476b-82f1-9bfaf2ea05b1 req-6ddac53a-1dcb-47ee-9afb-04b56e2c519f service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:06.943097 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-412dbd7d-96d8-476b-82f1-9bfaf2ea05b1 req-6ddac53a-1dcb-47ee-9afb-04b56e2c519f service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:06.955118 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-412dbd7d-96d8-476b-82f1-9bfaf2ea05b1 req-6ddac53a-1dcb-47ee-9afb-04b56e2c519f service nova] Creating event network-vif-plugged:a7b84cbd-9e1d-4379-a29a-842372c152b3 for instance 4eabe504-22f6-43b9-bc56-a312814d450f on hv-cinder-83800 Sep 03 01:43:06.960505 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-412dbd7d-96d8-476b-82f1-9bfaf2ea05b1 req-6ddac53a-1dcb-47ee-9afb-04b56e2c519f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032030 Sep 03 01:43:06.961119 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 620/1212] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:43:07.252755 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ecafdc13-c6b9-4f8f-ba24-234734e917e8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:07.253359 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ecafdc13-c6b9-4f8f-ba24-234734e917e8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:07.255309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=10 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:43:07.260032 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecafdc13-c6b9-4f8f-ba24-234734e917e8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:07.260506 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecafdc13-c6b9-4f8f-ba24-234734e917e8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:07.260936 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecafdc13-c6b9-4f8f-ba24-234734e917e8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:07.261612 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecafdc13-c6b9-4f8f-ba24-234734e917e8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:07.262059 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecafdc13-c6b9-4f8f-ba24-234734e917e8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:07.262512 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecafdc13-c6b9-4f8f-ba24-234734e917e8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:07.392484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ecafdc13-c6b9-4f8f-ba24-234734e917e8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:07.400540 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ecafdc13-c6b9-4f8f-ba24-234734e917e8 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1464 microversion: 2.1 time: 0.151715 Sep 03 01:43:07.401165 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 593/1213] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:07 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1464 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:07.456485 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-14e644a5-c759-4e76-a339-1e8cd1130081 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:07.456485 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-14e644a5-c759-4e76-a339-1e8cd1130081 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:07.458533 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14e644a5-c759-4e76-a339-1e8cd1130081 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:07.459020 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14e644a5-c759-4e76-a339-1e8cd1130081 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:07.459454 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14e644a5-c759-4e76-a339-1e8cd1130081 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:07.460355 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14e644a5-c759-4e76-a339-1e8cd1130081 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:07.460847 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14e644a5-c759-4e76-a339-1e8cd1130081 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:07.461272 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-14e644a5-c759-4e76-a339-1e8cd1130081 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:07.486745 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-14e644a5-c759-4e76-a339-1e8cd1130081 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Going to try to terminate instance {{(pid=127552) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:43:07.589739 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-fa050c98-11ec-4b43-bf77-667083631ee4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:07.590414 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-fa050c98-11ec-4b43-bf77-667083631ee4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:07.598034 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fa050c98-11ec-4b43-bf77-667083631ee4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:07.598560 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fa050c98-11ec-4b43-bf77-667083631ee4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:07.602174 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fa050c98-11ec-4b43-bf77-667083631ee4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:07.602174 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fa050c98-11ec-4b43-bf77-667083631ee4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:07.602174 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fa050c98-11ec-4b43-bf77-667083631ee4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:07.602174 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-fa050c98-11ec-4b43-bf77-667083631ee4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:07.743279 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-fa050c98-11ec-4b43-bf77-667083631ee4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:07.752546 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-fa050c98-11ec-4b43-bf77-667083631ee4 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1264 microversion: 2.1 time: 0.166540 Sep 03 01:43:07.753436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 594/1214] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:07 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:43:07.860962 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-14e644a5-c759-4e76-a339-1e8cd1130081 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 204 len: 0 microversion: 2.1 time: 0.414479 Sep 03 01:43:07.862409 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 621/1215] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:43:07 2022] DELETE /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 0 bytes in 417 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 03 01:43:07.870514 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6d4795ae-dec1-463e-93de-56bc2be526f5 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:07.871127 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6d4795ae-dec1-463e-93de-56bc2be526f5 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:07.877676 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6d4795ae-dec1-463e-93de-56bc2be526f5 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:07.881752 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6d4795ae-dec1-463e-93de-56bc2be526f5 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:07.881752 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6d4795ae-dec1-463e-93de-56bc2be526f5 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:07.881752 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6d4795ae-dec1-463e-93de-56bc2be526f5 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:07.881752 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6d4795ae-dec1-463e-93de-56bc2be526f5 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:07.882189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6d4795ae-dec1-463e-93de-56bc2be526f5 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:08.253073 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6d4795ae-dec1-463e-93de-56bc2be526f5 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:08.260704 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6d4795ae-dec1-463e-93de-56bc2be526f5 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1470 microversion: 2.1 time: 0.394167 Sep 03 01:43:08.261261 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 595/1216] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:07 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1470 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:08.777537 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-62df9e98-4128-4348-a9f0-c113b5cf2c39 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:08.778234 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-62df9e98-4128-4348-a9f0-c113b5cf2c39 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:08.785765 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62df9e98-4128-4348-a9f0-c113b5cf2c39 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:08.786274 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62df9e98-4128-4348-a9f0-c113b5cf2c39 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:08.786731 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62df9e98-4128-4348-a9f0-c113b5cf2c39 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:08.787416 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62df9e98-4128-4348-a9f0-c113b5cf2c39 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:08.787867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62df9e98-4128-4348-a9f0-c113b5cf2c39 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:08.788289 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-62df9e98-4128-4348-a9f0-c113b5cf2c39 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:08.919621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-62df9e98-4128-4348-a9f0-c113b5cf2c39 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:08.927463 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-62df9e98-4128-4348-a9f0-c113b5cf2c39 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1264 microversion: 2.1 time: 0.154233 Sep 03 01:43:08.928029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 622/1217] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:08 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:09.284434 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6cf80c84-6988-48d3-89e3-9708fd415487 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:09.285081 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6cf80c84-6988-48d3-89e3-9708fd415487 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:09.292185 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6cf80c84-6988-48d3-89e3-9708fd415487 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:09.292676 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6cf80c84-6988-48d3-89e3-9708fd415487 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:09.293110 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6cf80c84-6988-48d3-89e3-9708fd415487 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:09.293822 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6cf80c84-6988-48d3-89e3-9708fd415487 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:09.294320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6cf80c84-6988-48d3-89e3-9708fd415487 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:09.294777 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6cf80c84-6988-48d3-89e3-9708fd415487 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:09.427081 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6cf80c84-6988-48d3-89e3-9708fd415487 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:09.434874 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6cf80c84-6988-48d3-89e3-9708fd415487 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1470 microversion: 2.1 time: 0.154649 Sep 03 01:43:09.439960 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 596/1218] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:09 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:09.950162 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2fbe93c3-8a7e-4fc2-8a29-4da048b279de tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:09.951735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2fbe93c3-8a7e-4fc2-8a29-4da048b279de tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:09.958020 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2fbe93c3-8a7e-4fc2-8a29-4da048b279de tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:09.958757 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2fbe93c3-8a7e-4fc2-8a29-4da048b279de tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:09.959204 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2fbe93c3-8a7e-4fc2-8a29-4da048b279de tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:09.966131 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2fbe93c3-8a7e-4fc2-8a29-4da048b279de tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:09.966131 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2fbe93c3-8a7e-4fc2-8a29-4da048b279de tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:09.966131 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2fbe93c3-8a7e-4fc2-8a29-4da048b279de tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:09.966131 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:43:10.171597 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2fbe93c3-8a7e-4fc2-8a29-4da048b279de tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:10.179376 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2fbe93c3-8a7e-4fc2-8a29-4da048b279de tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1451 microversion: 2.1 time: 0.234204 Sep 03 01:43:10.179946 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 623/1219] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:09 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1451 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:43:10.201730 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-29af8b47-2472-4e37-b3c8-b84c1be16ab9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:10.202352 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-29af8b47-2472-4e37-b3c8-b84c1be16ab9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:10.208479 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-29af8b47-2472-4e37-b3c8-b84c1be16ab9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:10.208972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-29af8b47-2472-4e37-b3c8-b84c1be16ab9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:10.209417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-29af8b47-2472-4e37-b3c8-b84c1be16ab9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:10.210114 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-29af8b47-2472-4e37-b3c8-b84c1be16ab9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:10.210604 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-29af8b47-2472-4e37-b3c8-b84c1be16ab9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:10.211039 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-29af8b47-2472-4e37-b3c8-b84c1be16ab9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:10.405683 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-7e9aa298-3090-4627-8833-fcd2b20d45f4 req-974388d0-1145-456c-9efe-55fbdcf734af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8a534200-13b1-4b2d-8bfa-1ed15e39465b", "name": "network-vif-deleted", "tag": "96eedadc-2aa0-43e2-b228-d2faf31c150b"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:43:10.415812 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-7e9aa298-3090-4627-8833-fcd2b20d45f4 req-974388d0-1145-456c-9efe-55fbdcf734af service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:10.416348 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-7e9aa298-3090-4627-8833-fcd2b20d45f4 req-974388d0-1145-456c-9efe-55fbdcf734af service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:10.416786 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-7e9aa298-3090-4627-8833-fcd2b20d45f4 req-974388d0-1145-456c-9efe-55fbdcf734af service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:10.423931 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-29af8b47-2472-4e37-b3c8-b84c1be16ab9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:10.432285 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-29af8b47-2472-4e37-b3c8-b84c1be16ab9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1451 microversion: 2.1 time: 0.234285 Sep 03 01:43:10.433075 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 597/1220] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:10 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1451 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:10.434701 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-7e9aa298-3090-4627-8833-fcd2b20d45f4 req-974388d0-1145-456c-9efe-55fbdcf734af service nova] Creating event network-vif-deleted:96eedadc-2aa0-43e2-b228-d2faf31c150b for instance 8a534200-13b1-4b2d-8bfa-1ed15e39465b on hv-cinder-83800 Sep 03 01:43:10.440738 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-7e9aa298-3090-4627-8833-fcd2b20d45f4 req-974388d0-1145-456c-9efe-55fbdcf734af service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039804 Sep 03 01:43:10.441550 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 624/1221] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:43:10.460075 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a5420878-5160-44e6-a04f-6e097c56e078 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:10.460793 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a5420878-5160-44e6-a04f-6e097c56e078 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:10.470312 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a5420878-5160-44e6-a04f-6e097c56e078 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:10.470842 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a5420878-5160-44e6-a04f-6e097c56e078 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:10.471286 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a5420878-5160-44e6-a04f-6e097c56e078 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:10.471998 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a5420878-5160-44e6-a04f-6e097c56e078 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:10.472634 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a5420878-5160-44e6-a04f-6e097c56e078 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:10.473292 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a5420878-5160-44e6-a04f-6e097c56e078 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:10.557624 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a5420878-5160-44e6-a04f-6e097c56e078 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:10.566592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a5420878-5160-44e6-a04f-6e097c56e078 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1428 microversion: 2.1 time: 0.110133 Sep 03 01:43:10.567689 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 598/1222] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:10 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1428 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:11.591652 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:11.592836 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:11.599577 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:11.600059 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:11.602875 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:11.602875 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:11.602875 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:11.602875 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:11.633867 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:11.634379 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:11.634812 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:11.635248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lazy-loading 'fault' on Instance uuid 8a534200-13b1-4b2d-8bfa-1ed15e39465b {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:43:11.940952 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7f3ca49df57440c0895389872f144036', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53d6048fb19e4828a58b35024ced4518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:11.948557 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e5da6fe6-3352-48c2-8e9b-1f3e19558f64 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 200 len: 1304 microversion: 2.1 time: 0.361139 Sep 03 01:43:11.949243 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 625/1223] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:11 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 1304 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:12.530374 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-9c180053-1f9e-4666-9723-f87d3cf94220 req-a695e3ea-44c4-41fc-98db-a77f1f3f49ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eabe504-22f6-43b9-bc56-a312814d450f", "tag": "a7b84cbd-9e1d-4379-a29a-842372c152b3"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:43:12.540580 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-9c180053-1f9e-4666-9723-f87d3cf94220 req-a695e3ea-44c4-41fc-98db-a77f1f3f49ba service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:12.541052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-9c180053-1f9e-4666-9723-f87d3cf94220 req-a695e3ea-44c4-41fc-98db-a77f1f3f49ba service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:12.541477 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-9c180053-1f9e-4666-9723-f87d3cf94220 req-a695e3ea-44c4-41fc-98db-a77f1f3f49ba service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:12.555369 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-9c180053-1f9e-4666-9723-f87d3cf94220 req-a695e3ea-44c4-41fc-98db-a77f1f3f49ba service nova] Creating event network-changed:a7b84cbd-9e1d-4379-a29a-842372c152b3 for instance 4eabe504-22f6-43b9-bc56-a312814d450f on hv-cinder-83800 Sep 03 01:43:12.560324 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-9c180053-1f9e-4666-9723-f87d3cf94220 req-a695e3ea-44c4-41fc-98db-a77f1f3f49ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033649 Sep 03 01:43:12.561782 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 599/1224] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:43:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:43:12.974200 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5f448024-4930-41e6-a95e-12a8f7f20b86 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:12.975115 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-5f448024-4930-41e6-a95e-12a8f7f20b86 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] [instance: 8a534200-13b1-4b2d-8bfa-1ed15e39465b] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:12.981921 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f448024-4930-41e6-a95e-12a8f7f20b86 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:12.983710 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f448024-4930-41e6-a95e-12a8f7f20b86 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:12.984549 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f448024-4930-41e6-a95e-12a8f7f20b86 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:12.985359 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f448024-4930-41e6-a95e-12a8f7f20b86 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:12.985909 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f448024-4930-41e6-a95e-12a8f7f20b86 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:12.986880 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-5f448024-4930-41e6-a95e-12a8f7f20b86 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:13.001384 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-5f448024-4930-41e6-a95e-12a8f7f20b86 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] HTTP exception thrown: Instance 8a534200-13b1-4b2d-8bfa-1ed15e39465b could not be found. Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5f448024-4930-41e6-a95e-12a8f7f20b86 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Request method failure captured: Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b HTTP/1.1 Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjErEcRSLRSDwWYLnS1TXZtOe00I7yE2thl0spbTsaXawrLuyOE9FnnDkBuLwbcuRz3Ohb7CXWz44yp_WYklHMXHHJhiwNYnYv3JrIDTgbDBmQv8vkSQVM99BFbfEbxpcjcqkxMmzhWGby7So5fdJZF3SG0mH-0U1EDfc4MgmcUxNbUGI Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: 53d6048fb19e4828a58b35024ced4518 Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-VolumesNegativeTest-1998609732 Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:43:13.003192 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:43:13.005032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_53d6048fb19e4828a58b35024ced4518"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/53d6048fb19e4828a58b35024ced4518"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53d6048fb19e4828a58b35024ced4518"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/53d6048fb19e4828a58b35024ced4518"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:43:13.005032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-VolumesNegativeTest-1998609732 Sep 03 01:43:13.005032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: 53d6048fb19e4828a58b35024ced4518 Sep 03 01:43:13.005032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-VolumesNegativeTest-1998609732 Sep 03 01:43:13.005032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-VolumesNegativeTest-1998609732-project Sep 03 01:43:13.005032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:43:13.005032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:43:13.005032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: 7f3ca49df57440c0895389872f144036 Sep 03 01:43:13.005032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-VolumesNegativeTest-1998609732-project Sep 03 01:43:13.005032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:43:13.005032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 8a534200-13b1-4b2d-8bfa-1ed15e39465b could not be found. Sep 03 01:43:13.005032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '8a534200-13b1-4b2d-8bfa-1ed15e39465b'} Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8a534200-13b1-4b2d-8bfa-1ed15e39465b could not be found. Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:43:13.006112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8a534200-13b1-4b2d-8bfa-1ed15e39465b could not be found. Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8a534200-13b1-4b2d-8bfa-1ed15e39465b could not be found. Sep 03 01:43:13.007735 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:43:13.009315 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-5f448024-4930-41e6-a95e-12a8f7f20b86 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] Returning 404 to user: Instance 8a534200-13b1-4b2d-8bfa-1ed15e39465b could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:43:13.009315 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-5f448024-4930-41e6-a95e-12a8f7f20b86 tempest-VolumesNegativeTest-1998609732 tempest-VolumesNegativeTest-1998609732-project] 10.222.0.13 "GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b" status: 404 len: 111 microversion: 2.1 time: 0.035301 Sep 03 01:43:13.009315 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 626/1225] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:12 2022] GET /compute/v2.1/servers/8a534200-13b1-4b2d-8bfa-1ed15e39465b => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:43:32.936670 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:43:32.937800 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=94 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:43:33.127320 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a48caba7-ea46-4e55-af5c-a739feed1b1b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Action: 'create', calling method: .version_select at 0x7f6d24998280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1569621273", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwbiOGG0QNg4VlzyOj6AopCQwn1rQQCNPCPN6F1Rii7o2FaySqnOPRLEZ3f84L4U8nXPSa0sTbJ/jp/dxyYeU+1ssJDOLjkQYj1fSjt+LLHJje7mjKB4mgAiwBg8TeYNw=="}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:43:33.145805 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-a48caba7-ea46-4e55-af5c-a739feed1b1b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Getting quotas for project 4c46ebe5d6a74509ba46325e2376d170. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:43:33.149720 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.quota [None req-a48caba7-ea46-4e55-af5c-a739feed1b1b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Getting quotas for user 7ebb858b78464e10a0fb011df133aaf1 and project 4c46ebe5d6a74509ba46325e2376d170. Resources: {'key_pairs'} {{(pid=127553) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:43:33.267565 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a48caba7-ea46-4e55-af5c-a739feed1b1b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.332722 Sep 03 01:43:33.268203 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 600/1226] 10.222.0.13 () {60 vars in 1159 bytes} [Sat Sep 3 01:43:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:43:53.172646 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1030920931", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1569621273", "security_groups": [{"name": "tempest-secgroup-smoke-2071208103"}], "networks": [{"uuid": "71082ff0-fba1-4b4f-ba63-b9807563ab29"}], "block_device_mapping_v2": [{"uuid": "a45ad4b6-d899-4324-a6c0-2922e7410020", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:43:53.184311 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 01:43:53.184474 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Sat Sep 3 01:43:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.13) !!! Sep 03 01:43:53.186398 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:43:53.187054 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=16 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:43:53.294504 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.network.neutron [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] validate_networks() for [('71082ff0-fba1-4b4f-ba63-b9807563ab29', None, None, None, None, None)] {{(pid=127552) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 03 01:43:53.755503 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Flavor limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 03 01:43:53.755930 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Image limits 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 03 01:43:53.756409 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Flavor pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 03 01:43:53.756817 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Image pref 0:0:0 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 03 01:43:53.757224 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.virt.hardware [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127552) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 03 01:43:53.766080 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:53.766591 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:53.767312 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:53.768048 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:53.768514 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:53.768938 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:53.791766 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Getting quotas for project 4c46ebe5d6a74509ba46325e2376d170. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 03 01:43:53.795990 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.quota [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Getting quotas for user 7ebb858b78464e10a0fb011df133aaf1 and project 4c46ebe5d6a74509ba46325e2376d170. Resources: {'instances', 'ram', 'cores'} {{(pid=127552) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 03 01:43:53.853664 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Going to run 1 instances... {{(pid=127552) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 03 01:43:53.855820 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a45ad4b6-d899-4324-a6c0-2922e7410020',volume_size=None,volume_type=None)] {{(pid=127552) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 03 01:43:54.384900 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-ba14d35d-0673-4afe-940f-7c898a9c5901 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.216227 Sep 03 01:43:54.385623 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 627/1227] 10.222.0.13 () {60 vars in 1147 bytes} [Sat Sep 3 01:43:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 1218 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 03 01:43:54.394463 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=4 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:43:54.395312 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:43:54.399121 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-26503ae2-dc2b-4720-9483-a0725c1a60ac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:54.400182 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-26503ae2-dc2b-4720-9483-a0725c1a60ac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:54.458994 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-26503ae2-dc2b-4720-9483-a0725c1a60ac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:54.467046 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-26503ae2-dc2b-4720-9483-a0725c1a60ac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1089 microversion: 2.1 time: 0.073999 Sep 03 01:43:54.471947 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 601/1228] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:54 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:55.490160 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-264131f9-0ff9-4616-a8dc-2c9cb354e0d5 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:55.490783 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-264131f9-0ff9-4616-a8dc-2c9cb354e0d5 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:55.543491 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-264131f9-0ff9-4616-a8dc-2c9cb354e0d5 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:55.550415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-264131f9-0ff9-4616-a8dc-2c9cb354e0d5 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1089 microversion: 2.1 time: 0.064642 Sep 03 01:43:55.550986 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 628/1229] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:55 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1089 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:56.573015 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6d4a978e-99be-427b-9d3a-930d8aee566f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:56.573621 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6d4a978e-99be-427b-9d3a-930d8aee566f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:56.580674 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6d4a978e-99be-427b-9d3a-930d8aee566f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:56.581152 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6d4a978e-99be-427b-9d3a-930d8aee566f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:56.581581 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6d4a978e-99be-427b-9d3a-930d8aee566f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:56.582257 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6d4a978e-99be-427b-9d3a-930d8aee566f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:56.582733 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6d4a978e-99be-427b-9d3a-930d8aee566f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:56.583153 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6d4a978e-99be-427b-9d3a-930d8aee566f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:56.644056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6d4a978e-99be-427b-9d3a-930d8aee566f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:56.652078 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6d4a978e-99be-427b-9d3a-930d8aee566f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1187 microversion: 2.1 time: 0.083042 Sep 03 01:43:56.652631 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 602/1230] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:56 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1187 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:57.674962 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7218acdc-d921-45a1-8f11-03d148a85f01 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:57.675536 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7218acdc-d921-45a1-8f11-03d148a85f01 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:57.683529 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7218acdc-d921-45a1-8f11-03d148a85f01 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:57.684022 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7218acdc-d921-45a1-8f11-03d148a85f01 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:57.684460 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7218acdc-d921-45a1-8f11-03d148a85f01 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:57.685166 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7218acdc-d921-45a1-8f11-03d148a85f01 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:57.685622 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7218acdc-d921-45a1-8f11-03d148a85f01 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:57.686046 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7218acdc-d921-45a1-8f11-03d148a85f01 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:57.750262 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7218acdc-d921-45a1-8f11-03d148a85f01 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:57.757935 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7218acdc-d921-45a1-8f11-03d148a85f01 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1205 microversion: 2.1 time: 0.087032 Sep 03 01:43:57.758530 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 629/1231] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:57 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1205 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:43:58.781240 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-b345e37c-d8d0-4e9e-962f-da49ffb5c086 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:43:58.781848 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-b345e37c-d8d0-4e9e-962f-da49ffb5c086 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:43:58.788614 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b345e37c-d8d0-4e9e-962f-da49ffb5c086 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:58.789095 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b345e37c-d8d0-4e9e-962f-da49ffb5c086 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:58.789526 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b345e37c-d8d0-4e9e-962f-da49ffb5c086 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:58.790214 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b345e37c-d8d0-4e9e-962f-da49ffb5c086 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:58.790707 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b345e37c-d8d0-4e9e-962f-da49ffb5c086 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:58.791275 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-b345e37c-d8d0-4e9e-962f-da49ffb5c086 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:58.937780 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-8adca72d-59e0-43fb-abb9-f037dc4ab9c6 req-6bee1439-e467-4005-9bab-d2b01f2acdcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce8f86d-7223-40db-9d53-68e5b4a309cd", "tag": "79c632ec-1548-4d13-bffa-aae5dd768fa7"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:43:58.948881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-8adca72d-59e0-43fb-abb9-f037dc4ab9c6 req-6bee1439-e467-4005-9bab-d2b01f2acdcb service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:43:58.949669 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-8adca72d-59e0-43fb-abb9-f037dc4ab9c6 req-6bee1439-e467-4005-9bab-d2b01f2acdcb service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:43:58.951225 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-8adca72d-59e0-43fb-abb9-f037dc4ab9c6 req-6bee1439-e467-4005-9bab-d2b01f2acdcb service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:43:58.965407 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-8adca72d-59e0-43fb-abb9-f037dc4ab9c6 req-6bee1439-e467-4005-9bab-d2b01f2acdcb service nova] Creating event network-changed:79c632ec-1548-4d13-bffa-aae5dd768fa7 for instance fce8f86d-7223-40db-9d53-68e5b4a309cd on hv-cinder-83800 Sep 03 01:43:58.970313 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-8adca72d-59e0-43fb-abb9-f037dc4ab9c6 req-6bee1439-e467-4005-9bab-d2b01f2acdcb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098186 Sep 03 01:43:58.971028 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 630/1232] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:43:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:43:58.989558 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-b345e37c-d8d0-4e9e-962f-da49ffb5c086 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:43:58.998074 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-b345e37c-d8d0-4e9e-962f-da49ffb5c086 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1261 microversion: 2.1 time: 0.220889 Sep 03 01:43:58.998695 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 603/1233] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:43:58 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1261 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:44:00.022004 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-72cb54c5-ecdb-443b-bd91-4a36423f3819 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:00.030393 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-72cb54c5-ecdb-443b-bd91-4a36423f3819 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:00.030393 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72cb54c5-ecdb-443b-bd91-4a36423f3819 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:00.030393 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72cb54c5-ecdb-443b-bd91-4a36423f3819 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:00.030393 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72cb54c5-ecdb-443b-bd91-4a36423f3819 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:00.031081 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72cb54c5-ecdb-443b-bd91-4a36423f3819 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:00.031527 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72cb54c5-ecdb-443b-bd91-4a36423f3819 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:00.031945 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-72cb54c5-ecdb-443b-bd91-4a36423f3819 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:00.162832 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-72cb54c5-ecdb-443b-bd91-4a36423f3819 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:00.171877 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-72cb54c5-ecdb-443b-bd91-4a36423f3819 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1261 microversion: 2.1 time: 0.154571 Sep 03 01:44:00.172444 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 631/1234] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:00 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:01.195304 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-74b03f29-5f1d-4fff-97a3-88572c2bbcc8 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:01.195911 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-74b03f29-5f1d-4fff-97a3-88572c2bbcc8 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:01.202560 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74b03f29-5f1d-4fff-97a3-88572c2bbcc8 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:01.203045 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74b03f29-5f1d-4fff-97a3-88572c2bbcc8 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:01.203484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74b03f29-5f1d-4fff-97a3-88572c2bbcc8 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:01.204170 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74b03f29-5f1d-4fff-97a3-88572c2bbcc8 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:01.204648 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74b03f29-5f1d-4fff-97a3-88572c2bbcc8 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:01.205069 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-74b03f29-5f1d-4fff-97a3-88572c2bbcc8 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:01.333362 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-74b03f29-5f1d-4fff-97a3-88572c2bbcc8 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:01.341978 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-74b03f29-5f1d-4fff-97a3-88572c2bbcc8 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1261 microversion: 2.1 time: 0.150570 Sep 03 01:44:01.342574 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 604/1235] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:01 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:02.365092 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a078934a-ab1f-4464-aae9-6202e5284067 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:02.365688 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a078934a-ab1f-4464-aae9-6202e5284067 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:02.373235 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a078934a-ab1f-4464-aae9-6202e5284067 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:02.373750 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a078934a-ab1f-4464-aae9-6202e5284067 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:02.374185 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a078934a-ab1f-4464-aae9-6202e5284067 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:02.374902 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a078934a-ab1f-4464-aae9-6202e5284067 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:02.375354 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a078934a-ab1f-4464-aae9-6202e5284067 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:02.375775 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a078934a-ab1f-4464-aae9-6202e5284067 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:02.504827 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a078934a-ab1f-4464-aae9-6202e5284067 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:02.512617 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a078934a-ab1f-4464-aae9-6202e5284067 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1261 microversion: 2.1 time: 0.151407 Sep 03 01:44:02.513183 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 632/1236] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:02 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1261 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:03.535522 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2afb91ff-fab5-49fe-89b8-b50ba9ba867f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:03.536396 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2afb91ff-fab5-49fe-89b8-b50ba9ba867f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:03.543671 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2afb91ff-fab5-49fe-89b8-b50ba9ba867f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:03.544156 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2afb91ff-fab5-49fe-89b8-b50ba9ba867f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:03.544593 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2afb91ff-fab5-49fe-89b8-b50ba9ba867f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:03.545285 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2afb91ff-fab5-49fe-89b8-b50ba9ba867f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:03.545743 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2afb91ff-fab5-49fe-89b8-b50ba9ba867f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:03.546171 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2afb91ff-fab5-49fe-89b8-b50ba9ba867f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:03.672709 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2afb91ff-fab5-49fe-89b8-b50ba9ba867f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:03.680319 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2afb91ff-fab5-49fe-89b8-b50ba9ba867f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1261 microversion: 2.1 time: 0.148730 Sep 03 01:44:03.680886 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 605/1237] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:03 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:04.704082 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7eeab129-63cc-4c45-908d-cb1e43ce90d1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:04.704722 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7eeab129-63cc-4c45-908d-cb1e43ce90d1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:04.707125 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=2 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:44:04.712125 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7eeab129-63cc-4c45-908d-cb1e43ce90d1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:04.712662 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7eeab129-63cc-4c45-908d-cb1e43ce90d1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:04.713485 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7eeab129-63cc-4c45-908d-cb1e43ce90d1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:04.714169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7eeab129-63cc-4c45-908d-cb1e43ce90d1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:04.714673 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7eeab129-63cc-4c45-908d-cb1e43ce90d1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:04.717235 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7eeab129-63cc-4c45-908d-cb1e43ce90d1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:04.851390 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7eeab129-63cc-4c45-908d-cb1e43ce90d1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:04.859211 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7eeab129-63cc-4c45-908d-cb1e43ce90d1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1261 microversion: 2.1 time: 0.158998 Sep 03 01:44:04.860425 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 633/1238] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:04 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1261 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:05.883064 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-761e27a6-b0f3-4d55-9d03-d8dbc9b5bf93 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:05.883985 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-761e27a6-b0f3-4d55-9d03-d8dbc9b5bf93 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:05.886636 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell0:SELECT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:44:05.891427 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-761e27a6-b0f3-4d55-9d03-d8dbc9b5bf93 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:05.891911 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-761e27a6-b0f3-4d55-9d03-d8dbc9b5bf93 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:05.892349 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-761e27a6-b0f3-4d55-9d03-d8dbc9b5bf93 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:05.893052 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-761e27a6-b0f3-4d55-9d03-d8dbc9b5bf93 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:05.893503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-761e27a6-b0f3-4d55-9d03-d8dbc9b5bf93 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:05.893938 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-761e27a6-b0f3-4d55-9d03-d8dbc9b5bf93 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:06.028117 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-761e27a6-b0f3-4d55-9d03-d8dbc9b5bf93 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:06.035716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-761e27a6-b0f3-4d55-9d03-d8dbc9b5bf93 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1261 microversion: 2.1 time: 0.156679 Sep 03 01:44:06.036534 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 606/1239] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:05 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:07.059065 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-39b45456-db2d-474e-9e88-ee6a8e462d1c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:07.059620 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-39b45456-db2d-474e-9e88-ee6a8e462d1c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:07.061415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell0:SELECT=8 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:44:07.066619 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39b45456-db2d-474e-9e88-ee6a8e462d1c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:07.067106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39b45456-db2d-474e-9e88-ee6a8e462d1c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:07.067541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39b45456-db2d-474e-9e88-ee6a8e462d1c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:07.068230 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39b45456-db2d-474e-9e88-ee6a8e462d1c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:07.068685 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39b45456-db2d-474e-9e88-ee6a8e462d1c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:07.069107 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-39b45456-db2d-474e-9e88-ee6a8e462d1c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:07.196389 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-39b45456-db2d-474e-9e88-ee6a8e462d1c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:07.204213 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-39b45456-db2d-474e-9e88-ee6a8e462d1c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1261 microversion: 2.1 time: 0.149213 Sep 03 01:44:07.204785 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 634/1240] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:07 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1261 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:08.227543 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-93b2b5d3-57c5-4d88-b716-aa05b0ea7129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:08.228700 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-93b2b5d3-57c5-4d88-b716-aa05b0ea7129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:08.235215 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93b2b5d3-57c5-4d88-b716-aa05b0ea7129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:08.235697 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93b2b5d3-57c5-4d88-b716-aa05b0ea7129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:08.236129 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93b2b5d3-57c5-4d88-b716-aa05b0ea7129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:08.236821 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93b2b5d3-57c5-4d88-b716-aa05b0ea7129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:08.237273 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93b2b5d3-57c5-4d88-b716-aa05b0ea7129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:08.237698 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-93b2b5d3-57c5-4d88-b716-aa05b0ea7129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:08.368706 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-93b2b5d3-57c5-4d88-b716-aa05b0ea7129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:08.377060 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-93b2b5d3-57c5-4d88-b716-aa05b0ea7129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1261 microversion: 2.1 time: 0.153452 Sep 03 01:44:08.377649 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 607/1241] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:08 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:09.400025 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b57d5d59-2362-4dc5-8edb-01ab1b75e972 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:09.400777 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b57d5d59-2362-4dc5-8edb-01ab1b75e972 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:09.407377 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b57d5d59-2362-4dc5-8edb-01ab1b75e972 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:09.407882 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b57d5d59-2362-4dc5-8edb-01ab1b75e972 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:09.408318 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b57d5d59-2362-4dc5-8edb-01ab1b75e972 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:09.409032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b57d5d59-2362-4dc5-8edb-01ab1b75e972 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:09.409490 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b57d5d59-2362-4dc5-8edb-01ab1b75e972 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:09.409913 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b57d5d59-2362-4dc5-8edb-01ab1b75e972 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:09.543753 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b57d5d59-2362-4dc5-8edb-01ab1b75e972 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:09.551370 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b57d5d59-2362-4dc5-8edb-01ab1b75e972 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1261 microversion: 2.1 time: 0.155350 Sep 03 01:44:09.551941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 635/1242] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:09 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:10.575226 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-9a11273a-85a9-4736-9eb1-266976e28b55 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:10.575836 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-9a11273a-85a9-4736-9eb1-266976e28b55 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:10.582198 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a11273a-85a9-4736-9eb1-266976e28b55 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:10.582711 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a11273a-85a9-4736-9eb1-266976e28b55 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:10.583145 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a11273a-85a9-4736-9eb1-266976e28b55 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:10.583829 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a11273a-85a9-4736-9eb1-266976e28b55 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:10.584287 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a11273a-85a9-4736-9eb1-266976e28b55 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:10.584709 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-9a11273a-85a9-4736-9eb1-266976e28b55 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:10.716116 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-9a11273a-85a9-4736-9eb1-266976e28b55 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:10.723846 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-9a11273a-85a9-4736-9eb1-266976e28b55 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1261 microversion: 2.1 time: 0.153265 Sep 03 01:44:10.724416 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 608/1243] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:10 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:11.109302 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-4c392ef3-251e-49ee-8b88-754e7df2a28f req-580e9764-af60-422a-8893-d08b427a35b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce8f86d-7223-40db-9d53-68e5b4a309cd", "name": "network-vif-plugged", "status": "completed", "tag": "79c632ec-1548-4d13-bffa-aae5dd768fa7"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:44:11.119787 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-4c392ef3-251e-49ee-8b88-754e7df2a28f req-580e9764-af60-422a-8893-d08b427a35b9 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:11.120668 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-4c392ef3-251e-49ee-8b88-754e7df2a28f req-580e9764-af60-422a-8893-d08b427a35b9 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:11.121102 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-4c392ef3-251e-49ee-8b88-754e7df2a28f req-580e9764-af60-422a-8893-d08b427a35b9 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:11.132263 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-4c392ef3-251e-49ee-8b88-754e7df2a28f req-580e9764-af60-422a-8893-d08b427a35b9 service nova] Creating event network-vif-plugged:79c632ec-1548-4d13-bffa-aae5dd768fa7 for instance fce8f86d-7223-40db-9d53-68e5b4a309cd on hv-cinder-83800 Sep 03 01:44:11.137858 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-4c392ef3-251e-49ee-8b88-754e7df2a28f req-580e9764-af60-422a-8893-d08b427a35b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086752 Sep 03 01:44:11.138590 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 636/1244] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:44:11.746446 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-479bb099-df76-483f-b027-081434b7b319 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:11.747135 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-479bb099-df76-483f-b027-081434b7b319 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:11.753592 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-479bb099-df76-483f-b027-081434b7b319 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:11.754083 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-479bb099-df76-483f-b027-081434b7b319 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:11.754559 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-479bb099-df76-483f-b027-081434b7b319 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:11.755253 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-479bb099-df76-483f-b027-081434b7b319 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:11.755705 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-479bb099-df76-483f-b027-081434b7b319 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:11.756129 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-479bb099-df76-483f-b027-081434b7b319 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:11.889956 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-479bb099-df76-483f-b027-081434b7b319 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:11.897613 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-479bb099-df76-483f-b027-081434b7b319 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1261 microversion: 2.1 time: 0.155144 Sep 03 01:44:11.898182 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 609/1245] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:11 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:12.921497 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-c93fcbc2-4b93-4ec3-bd39-97e5a1c5713f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:12.922195 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-c93fcbc2-4b93-4ec3-bd39-97e5a1c5713f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:12.928838 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c93fcbc2-4b93-4ec3-bd39-97e5a1c5713f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:12.929317 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c93fcbc2-4b93-4ec3-bd39-97e5a1c5713f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:12.929751 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c93fcbc2-4b93-4ec3-bd39-97e5a1c5713f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:12.930474 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c93fcbc2-4b93-4ec3-bd39-97e5a1c5713f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:12.930929 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c93fcbc2-4b93-4ec3-bd39-97e5a1c5713f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:12.931864 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-c93fcbc2-4b93-4ec3-bd39-97e5a1c5713f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:13.065437 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-c93fcbc2-4b93-4ec3-bd39-97e5a1c5713f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:13.073792 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-c93fcbc2-4b93-4ec3-bd39-97e5a1c5713f tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1445 microversion: 2.1 time: 0.156564 Sep 03 01:44:13.078020 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 637/1246] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:12 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:13.096481 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d61618c3-d9b8-4aac-8c9d-f2415a88f5fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:13.097088 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d61618c3-d9b8-4aac-8c9d-f2415a88f5fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:13.103750 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d61618c3-d9b8-4aac-8c9d-f2415a88f5fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:13.104230 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d61618c3-d9b8-4aac-8c9d-f2415a88f5fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:13.104661 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d61618c3-d9b8-4aac-8c9d-f2415a88f5fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:13.105348 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d61618c3-d9b8-4aac-8c9d-f2415a88f5fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:13.105807 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d61618c3-d9b8-4aac-8c9d-f2415a88f5fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:13.106217 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d61618c3-d9b8-4aac-8c9d-f2415a88f5fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:13.240845 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d61618c3-d9b8-4aac-8c9d-f2415a88f5fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:13.250660 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d61618c3-d9b8-4aac-8c9d-f2415a88f5fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1445 microversion: 2.1 time: 0.158027 Sep 03 01:44:13.251289 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 610/1247] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:13 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1445 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:15.467291 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-fc328a51-58c9-4270-97ff-f558a55c3897 req-5c7e1f5e-e7cb-41b5-993f-f487b5dab7ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce8f86d-7223-40db-9d53-68e5b4a309cd", "tag": "79c632ec-1548-4d13-bffa-aae5dd768fa7"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:44:15.477395 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-fc328a51-58c9-4270-97ff-f558a55c3897 req-5c7e1f5e-e7cb-41b5-993f-f487b5dab7ce service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:15.477910 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-fc328a51-58c9-4270-97ff-f558a55c3897 req-5c7e1f5e-e7cb-41b5-993f-f487b5dab7ce service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:15.479055 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-fc328a51-58c9-4270-97ff-f558a55c3897 req-5c7e1f5e-e7cb-41b5-993f-f487b5dab7ce service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:15.490283 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-fc328a51-58c9-4270-97ff-f558a55c3897 req-5c7e1f5e-e7cb-41b5-993f-f487b5dab7ce service nova] Creating event network-changed:79c632ec-1548-4d13-bffa-aae5dd768fa7 for instance fce8f86d-7223-40db-9d53-68e5b4a309cd on hv-cinder-83800 Sep 03 01:44:15.495589 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-fc328a51-58c9-4270-97ff-f558a55c3897 req-5c7e1f5e-e7cb-41b5-993f-f487b5dab7ce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032847 Sep 03 01:44:15.496247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 638/1248] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:44:44.973929 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0430ee7d-c3a0-447b-8c5e-bed5fd749186 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:44.974493 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-0430ee7d-c3a0-447b-8c5e-bed5fd749186 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:44.976610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=22 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:44:44.977106 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:44:44.977580 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=54 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:44:44.978718 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=50 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:44:44.982955 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0430ee7d-c3a0-447b-8c5e-bed5fd749186 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:44.983514 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0430ee7d-c3a0-447b-8c5e-bed5fd749186 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:44.984020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0430ee7d-c3a0-447b-8c5e-bed5fd749186 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:44.984873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0430ee7d-c3a0-447b-8c5e-bed5fd749186 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:44.985327 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0430ee7d-c3a0-447b-8c5e-bed5fd749186 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:44.985754 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0430ee7d-c3a0-447b-8c5e-bed5fd749186 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:45.012272 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-0430ee7d-c3a0-447b-8c5e-bed5fd749186 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:44:45.040352 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-e5164052-3132-4b5b-8f9c-c3ed9eec2764 req-b7c2ef3a-b26f-48ef-bace-23274186f387 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4eabe504-22f6-43b9-bc56-a312814d450f", "tag": "a7b84cbd-9e1d-4379-a29a-842372c152b3"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:44:45.050480 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-e5164052-3132-4b5b-8f9c-c3ed9eec2764 req-b7c2ef3a-b26f-48ef-bace-23274186f387 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:45.051337 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-e5164052-3132-4b5b-8f9c-c3ed9eec2764 req-b7c2ef3a-b26f-48ef-bace-23274186f387 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:45.051820 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-e5164052-3132-4b5b-8f9c-c3ed9eec2764 req-b7c2ef3a-b26f-48ef-bace-23274186f387 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:45.063851 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-e5164052-3132-4b5b-8f9c-c3ed9eec2764 req-b7c2ef3a-b26f-48ef-bace-23274186f387 service nova] Creating event network-changed:a7b84cbd-9e1d-4379-a29a-842372c152b3 for instance 4eabe504-22f6-43b9-bc56-a312814d450f on hv-cinder-83800 Sep 03 01:44:45.069632 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-e5164052-3132-4b5b-8f9c-c3ed9eec2764 req-b7c2ef3a-b26f-48ef-bace-23274186f387 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098250 Sep 03 01:44:45.070234 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 639/1249] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:44:45.337681 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0430ee7d-c3a0-447b-8c5e-bed5fd749186 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 204 len: 0 microversion: 2.1 time: 0.368430 Sep 03 01:44:45.338290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 611/1250] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:44:44 2022] DELETE /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:44:45.347378 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-e4db0cf5-c8a4-4392-a6d7-ccf94b1b58db tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:45.348489 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-e4db0cf5-c8a4-4392-a6d7-ccf94b1b58db tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:45.356022 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e4db0cf5-c8a4-4392-a6d7-ccf94b1b58db tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:45.361266 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e4db0cf5-c8a4-4392-a6d7-ccf94b1b58db tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:45.361266 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e4db0cf5-c8a4-4392-a6d7-ccf94b1b58db tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:45.361266 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e4db0cf5-c8a4-4392-a6d7-ccf94b1b58db tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:45.361266 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e4db0cf5-c8a4-4392-a6d7-ccf94b1b58db tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:45.361661 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-e4db0cf5-c8a4-4392-a6d7-ccf94b1b58db tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:45.492144 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-e4db0cf5-c8a4-4392-a6d7-ccf94b1b58db tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:45.500139 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-e4db0cf5-c8a4-4392-a6d7-ccf94b1b58db tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1576 microversion: 2.1 time: 0.157218 Sep 03 01:44:45.500726 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 640/1251] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:45 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:44:46.525240 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e04ecf40-8b40-4146-9b46-7356c3c37f7e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:46.525948 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e04ecf40-8b40-4146-9b46-7356c3c37f7e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:46.532487 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e04ecf40-8b40-4146-9b46-7356c3c37f7e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:46.532972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e04ecf40-8b40-4146-9b46-7356c3c37f7e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:46.533409 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e04ecf40-8b40-4146-9b46-7356c3c37f7e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:46.534106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e04ecf40-8b40-4146-9b46-7356c3c37f7e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:46.534588 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e04ecf40-8b40-4146-9b46-7356c3c37f7e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:46.535018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e04ecf40-8b40-4146-9b46-7356c3c37f7e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:46.742086 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-e04ecf40-8b40-4146-9b46-7356c3c37f7e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:46.749780 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e04ecf40-8b40-4146-9b46-7356c3c37f7e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1576 microversion: 2.1 time: 0.229557 Sep 03 01:44:46.750586 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 612/1252] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:46 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1576 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:47.605094 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-74eff810-e329-410a-8074-59969d563c5f req-901991db-d55b-4a60-a70e-0964d7523c67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4eabe504-22f6-43b9-bc56-a312814d450f", "name": "network-vif-deleted", "tag": "a7b84cbd-9e1d-4379-a29a-842372c152b3"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:44:47.614586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-74eff810-e329-410a-8074-59969d563c5f req-901991db-d55b-4a60-a70e-0964d7523c67 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:47.615063 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-74eff810-e329-410a-8074-59969d563c5f req-901991db-d55b-4a60-a70e-0964d7523c67 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:47.615488 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-74eff810-e329-410a-8074-59969d563c5f req-901991db-d55b-4a60-a70e-0964d7523c67 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:47.626721 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-74eff810-e329-410a-8074-59969d563c5f req-901991db-d55b-4a60-a70e-0964d7523c67 service nova] Creating event network-vif-deleted:a7b84cbd-9e1d-4379-a29a-842372c152b3 for instance 4eabe504-22f6-43b9-bc56-a312814d450f on hv-cinder-83800 Sep 03 01:44:47.631697 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-74eff810-e329-410a-8074-59969d563c5f req-901991db-d55b-4a60-a70e-0964d7523c67 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030978 Sep 03 01:44:47.632680 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 641/1253] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:44:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:44:47.773075 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6c889c30-eac6-40b3-91c4-d548b917d715 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:47.773693 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6c889c30-eac6-40b3-91c4-d548b917d715 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:47.780616 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6c889c30-eac6-40b3-91c4-d548b917d715 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:47.781106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6c889c30-eac6-40b3-91c4-d548b917d715 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:47.781548 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6c889c30-eac6-40b3-91c4-d548b917d715 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:47.782243 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6c889c30-eac6-40b3-91c4-d548b917d715 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:47.782730 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6c889c30-eac6-40b3-91c4-d548b917d715 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:47.783155 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6c889c30-eac6-40b3-91c4-d548b917d715 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:47.849503 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6c889c30-eac6-40b3-91c4-d548b917d715 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:47.857822 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6c889c30-eac6-40b3-91c4-d548b917d715 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1223 microversion: 2.1 time: 0.088753 Sep 03 01:44:47.858414 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 613/1254] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:47 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:48.880587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:48.881286 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:48.888538 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:48.889027 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:48.889468 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:48.890597 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:48.890726 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:48.891076 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:48.929215 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:48.929698 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:48.930132 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:48.930614 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lazy-loading 'fault' on Instance uuid 4eabe504-22f6-43b9-bc56-a312814d450f {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:44:48.971856 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:48.979703 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-edf61529-fd8c-4a5e-ba3a-d6ca499b3387 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 200 len: 1228 microversion: 2.1 time: 0.103352 Sep 03 01:44:48.980263 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 642/1255] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:48 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 1228 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:50.002670 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-63e00199-1dcd-49f8-96c0-d0c9a87047b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:50.003363 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-63e00199-1dcd-49f8-96c0-d0c9a87047b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 4eabe504-22f6-43b9-bc56-a312814d450f] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:50.011490 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e00199-1dcd-49f8-96c0-d0c9a87047b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:50.011490 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e00199-1dcd-49f8-96c0-d0c9a87047b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:50.011769 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e00199-1dcd-49f8-96c0-d0c9a87047b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:50.014256 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e00199-1dcd-49f8-96c0-d0c9a87047b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:50.014256 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e00199-1dcd-49f8-96c0-d0c9a87047b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:50.014256 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-63e00199-1dcd-49f8-96c0-d0c9a87047b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:50.027329 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-63e00199-1dcd-49f8-96c0-d0c9a87047b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] HTTP exception thrown: Instance 4eabe504-22f6-43b9-bc56-a312814d450f could not be found. Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-63e00199-1dcd-49f8-96c0-d0c9a87047b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Request method failure captured: Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f HTTP/1.1 Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq_Hp85Ji5ahqSYGHPznqTsZqVBFpN4oM1k2zvkbtf37dFWD8C2gxNwIGt-SUBSNk-I4d2ndeBN9lbJOx2zaFhOZ-ObQEcrEMW1lOy4rr-oQyR8vk6SrWdWl-JNU1u7lEvdcfJiLXCflwmcVT_Umh8mp6q6att8j6FuGyhkuxZ9CF-M Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: c306d09e93584320b34697dba7641ac8 Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:44:50.029009 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:44:50.030824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c306d09e93584320b34697dba7641ac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c306d09e93584320b34697dba7641ac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c306d09e93584320b34697dba7641ac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c306d09e93584320b34697dba7641ac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:44:50.030824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:44:50.030824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: c306d09e93584320b34697dba7641ac8 Sep 03 01:44:50.030824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:44:50.030824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-TestVolumeBootPattern-1645626888-project Sep 03 01:44:50.030824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:44:50.030824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:44:50.030824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: df0ffa9f450642cc94ed828cb34034b5 Sep 03 01:44:50.030824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-TestVolumeBootPattern-1645626888-project Sep 03 01:44:50.030824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:44:50.030824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 4eabe504-22f6-43b9-bc56-a312814d450f could not be found. Sep 03 01:44:50.030824 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '4eabe504-22f6-43b9-bc56-a312814d450f'} Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4eabe504-22f6-43b9-bc56-a312814d450f could not be found. Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:44:50.031716 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4eabe504-22f6-43b9-bc56-a312814d450f could not be found. Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4eabe504-22f6-43b9-bc56-a312814d450f could not be found. Sep 03 01:44:50.033189 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:50.034640 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-63e00199-1dcd-49f8-96c0-d0c9a87047b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Returning 404 to user: Instance 4eabe504-22f6-43b9-bc56-a312814d450f could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:44:50.034640 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-63e00199-1dcd-49f8-96c0-d0c9a87047b0 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f" status: 404 len: 111 microversion: 2.1 time: 0.032728 Sep 03 01:44:50.034640 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 614/1256] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:49 2022] GET /compute/v2.1/servers/4eabe504-22f6-43b9-bc56-a312814d450f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:44:53.346718 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-a82f8390-c6ab-4676-9c34-382b6f523e46 req-a574ec32-cbaf-42a0-a7b6-21589d7e67f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76830239-8685-42c5-98e6-e5fd654d77d7", "tag": "9ea8f48a-f00d-4263-8d2c-f16a754b34e4"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:44:53.348601 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a2efa2f2-3467-4a37-a698-8b386c61fd3f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:53.349169 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a2efa2f2-3467-4a37-a698-8b386c61fd3f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:53.356699 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a82f8390-c6ab-4676-9c34-382b6f523e46 req-a574ec32-cbaf-42a0-a7b6-21589d7e67f5 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:53.357185 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a82f8390-c6ab-4676-9c34-382b6f523e46 req-a574ec32-cbaf-42a0-a7b6-21589d7e67f5 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:53.357326 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2efa2f2-3467-4a37-a698-8b386c61fd3f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:53.357618 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a82f8390-c6ab-4676-9c34-382b6f523e46 req-a574ec32-cbaf-42a0-a7b6-21589d7e67f5 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:53.357809 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2efa2f2-3467-4a37-a698-8b386c61fd3f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:53.358417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2efa2f2-3467-4a37-a698-8b386c61fd3f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:53.359659 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2efa2f2-3467-4a37-a698-8b386c61fd3f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:53.360182 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2efa2f2-3467-4a37-a698-8b386c61fd3f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:53.360810 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a2efa2f2-3467-4a37-a698-8b386c61fd3f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:53.371257 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-a82f8390-c6ab-4676-9c34-382b6f523e46 req-a574ec32-cbaf-42a0-a7b6-21589d7e67f5 service nova] Creating event network-changed:9ea8f48a-f00d-4263-8d2c-f16a754b34e4 for instance 76830239-8685-42c5-98e6-e5fd654d77d7 on hv-cinder-83800 Sep 03 01:44:53.376550 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-a82f8390-c6ab-4676-9c34-382b6f523e46 req-a574ec32-cbaf-42a0-a7b6-21589d7e67f5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033630 Sep 03 01:44:53.377473 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 643/1257] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:44:53.388099 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a2efa2f2-3467-4a37-a698-8b386c61fd3f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:44:53.779433 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a2efa2f2-3467-4a37-a698-8b386c61fd3f tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "DELETE /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 204 len: 0 microversion: 2.1 time: 0.434631 Sep 03 01:44:53.780603 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 615/1258] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:44:53 2022] DELETE /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:44:53.789828 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-bba2428e-0085-4e93-b35b-df92b3c2a7b9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:53.790804 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-bba2428e-0085-4e93-b35b-df92b3c2a7b9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:53.797636 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bba2428e-0085-4e93-b35b-df92b3c2a7b9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:53.800941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bba2428e-0085-4e93-b35b-df92b3c2a7b9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:53.800941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bba2428e-0085-4e93-b35b-df92b3c2a7b9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:53.800941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bba2428e-0085-4e93-b35b-df92b3c2a7b9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:53.800941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bba2428e-0085-4e93-b35b-df92b3c2a7b9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:53.801315 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-bba2428e-0085-4e93-b35b-df92b3c2a7b9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:53.939582 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-bba2428e-0085-4e93-b35b-df92b3c2a7b9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:53.948783 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-bba2428e-0085-4e93-b35b-df92b3c2a7b9 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1575 microversion: 2.1 time: 0.163641 Sep 03 01:44:53.949752 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 644/1259] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:53 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:54.973328 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-188f3c5c-514b-414c-abb5-ddb6ff4ff426 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:54.974118 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-188f3c5c-514b-414c-abb5-ddb6ff4ff426 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:54.981204 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-188f3c5c-514b-414c-abb5-ddb6ff4ff426 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:54.981687 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-188f3c5c-514b-414c-abb5-ddb6ff4ff426 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:54.982119 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-188f3c5c-514b-414c-abb5-ddb6ff4ff426 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:54.982842 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-188f3c5c-514b-414c-abb5-ddb6ff4ff426 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:54.983289 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-188f3c5c-514b-414c-abb5-ddb6ff4ff426 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:54.983711 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-188f3c5c-514b-414c-abb5-ddb6ff4ff426 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:55.143289 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-188f3c5c-514b-414c-abb5-ddb6ff4ff426 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:55.152512 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-188f3c5c-514b-414c-abb5-ddb6ff4ff426 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1575 microversion: 2.1 time: 0.183435 Sep 03 01:44:55.153097 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 616/1260] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:54 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1575 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:56.106713 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-a63b6288-f4a3-40b1-aefe-ee22b0b069f0 req-39fd8bc1-d058-456f-8646-6e641f75c23e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76830239-8685-42c5-98e6-e5fd654d77d7", "name": "network-vif-deleted", "tag": "9ea8f48a-f00d-4263-8d2c-f16a754b34e4"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:44:56.117331 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a63b6288-f4a3-40b1-aefe-ee22b0b069f0 req-39fd8bc1-d058-456f-8646-6e641f75c23e service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:56.117807 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a63b6288-f4a3-40b1-aefe-ee22b0b069f0 req-39fd8bc1-d058-456f-8646-6e641f75c23e service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:56.118247 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-a63b6288-f4a3-40b1-aefe-ee22b0b069f0 req-39fd8bc1-d058-456f-8646-6e641f75c23e service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:56.129290 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-a63b6288-f4a3-40b1-aefe-ee22b0b069f0 req-39fd8bc1-d058-456f-8646-6e641f75c23e service nova] Creating event network-vif-deleted:9ea8f48a-f00d-4263-8d2c-f16a754b34e4 for instance 76830239-8685-42c5-98e6-e5fd654d77d7 on hv-cinder-83800 Sep 03 01:44:56.134175 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-a63b6288-f4a3-40b1-aefe-ee22b0b069f0 req-39fd8bc1-d058-456f-8646-6e641f75c23e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031124 Sep 03 01:44:56.134822 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 645/1261] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:44:56.177142 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-674f6aac-ca44-4738-b18e-0b6cd192bbfc tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:56.177729 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-674f6aac-ca44-4738-b18e-0b6cd192bbfc tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:56.184869 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-674f6aac-ca44-4738-b18e-0b6cd192bbfc tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:56.185361 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-674f6aac-ca44-4738-b18e-0b6cd192bbfc tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:56.185802 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-674f6aac-ca44-4738-b18e-0b6cd192bbfc tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:56.186573 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-674f6aac-ca44-4738-b18e-0b6cd192bbfc tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:56.187031 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-674f6aac-ca44-4738-b18e-0b6cd192bbfc tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:56.187459 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-674f6aac-ca44-4738-b18e-0b6cd192bbfc tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:56.251190 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-674f6aac-ca44-4738-b18e-0b6cd192bbfc tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:56.259005 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-674f6aac-ca44-4738-b18e-0b6cd192bbfc tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1389 microversion: 2.1 time: 0.085937 Sep 03 01:44:56.259579 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 617/1262] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:56 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:57.283360 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:57.284085 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:57.291293 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:57.291781 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:57.292223 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:57.292915 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:57.293373 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:57.293800 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:57.328356 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:57.328842 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:57.329379 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:57.329826 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lazy-loading 'fault' on Instance uuid 76830239-8685-42c5-98e6-e5fd654d77d7 {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:44:57.376023 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df0ffa9f450642cc94ed828cb34034b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c306d09e93584320b34697dba7641ac8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:44:57.383715 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d837e257-b8b9-41d1-9b6f-9ffce98b6dcb tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 200 len: 1229 microversion: 2.1 time: 0.105227 Sep 03 01:44:57.384284 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 646/1263] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:57 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 1229 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:44:58.407044 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e59c3405-1d52-403f-a40c-d8668a0df840 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:58.407639 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-e59c3405-1d52-403f-a40c-d8668a0df840 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 76830239-8685-42c5-98e6-e5fd654d77d7] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:58.415124 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e59c3405-1d52-403f-a40c-d8668a0df840 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:58.415608 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e59c3405-1d52-403f-a40c-d8668a0df840 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:58.416041 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e59c3405-1d52-403f-a40c-d8668a0df840 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:58.416719 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e59c3405-1d52-403f-a40c-d8668a0df840 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:58.417166 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e59c3405-1d52-403f-a40c-d8668a0df840 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:58.417586 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-e59c3405-1d52-403f-a40c-d8668a0df840 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:58.431192 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-e59c3405-1d52-403f-a40c-d8668a0df840 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] HTTP exception thrown: Instance 76830239-8685-42c5-98e6-e5fd654d77d7 could not be found. Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e59c3405-1d52-403f-a40c-d8668a0df840 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Request method failure captured: Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 HTTP/1.1 Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq_Hp85Ji5ahqSYGHPznqTsZqVBFpN4oM1k2zvkbtf37dFWD8C2gxNwIGt-SUBSNk-I4d2ndeBN9lbJOx2zaFhOZ-ObQEcrEMW1lOy4rr-oQyR8vk6SrWdWl-JNU1u7lEvdcfJiLXCflwmcVT_Umh8mp6q6att8j6FuGyhkuxZ9CF-M Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: c306d09e93584320b34697dba7641ac8 Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:44:58.432806 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:44:58.434610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c306d09e93584320b34697dba7641ac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c306d09e93584320b34697dba7641ac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c306d09e93584320b34697dba7641ac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c306d09e93584320b34697dba7641ac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:44:58.434610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:44:58.434610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: c306d09e93584320b34697dba7641ac8 Sep 03 01:44:58.434610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:44:58.434610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-TestVolumeBootPattern-1645626888-project Sep 03 01:44:58.434610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:44:58.434610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:44:58.434610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: df0ffa9f450642cc94ed828cb34034b5 Sep 03 01:44:58.434610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-TestVolumeBootPattern-1645626888-project Sep 03 01:44:58.434610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:44:58.434610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 76830239-8685-42c5-98e6-e5fd654d77d7 could not be found. Sep 03 01:44:58.434610 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '76830239-8685-42c5-98e6-e5fd654d77d7'} Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76830239-8685-42c5-98e6-e5fd654d77d7 could not be found. Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:44:58.435650 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76830239-8685-42c5-98e6-e5fd654d77d7 could not be found. Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76830239-8685-42c5-98e6-e5fd654d77d7 could not be found. Sep 03 01:44:58.437309 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:58.438825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-e59c3405-1d52-403f-a40c-d8668a0df840 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Returning 404 to user: Instance 76830239-8685-42c5-98e6-e5fd654d77d7 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:44:58.438825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-e59c3405-1d52-403f-a40c-d8668a0df840 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7" status: 404 len: 111 microversion: 2.1 time: 0.031043 Sep 03 01:44:58.438825 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 618/1264] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:58 2022] GET /compute/v2.1/servers/76830239-8685-42c5-98e6-e5fd654d77d7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:44:58.984542 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9f92c6fb-bb6a-47df-96bf-d5883e48109e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:58.985021 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9f92c6fb-bb6a-47df-96bf-d5883e48109e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:58.991471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9f92c6fb-bb6a-47df-96bf-d5883e48109e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:58.991976 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9f92c6fb-bb6a-47df-96bf-d5883e48109e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:58.992411 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9f92c6fb-bb6a-47df-96bf-d5883e48109e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:58.993093 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9f92c6fb-bb6a-47df-96bf-d5883e48109e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:58.993541 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9f92c6fb-bb6a-47df-96bf-d5883e48109e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:58.993957 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9f92c6fb-bb6a-47df-96bf-d5883e48109e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:59.007817 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.wsgi [None req-9f92c6fb-bb6a-47df-96bf-d5883e48109e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] HTTP exception thrown: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9f92c6fb-bb6a-47df-96bf-d5883e48109e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Request method failure captured: Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: request: DELETE /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 HTTP/1.1 Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept: application/json Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Accept-Encoding: identity Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Connection: close Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Length: 0 Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Content-Type: application/json Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Host: 10.222.0.13 Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Openstack-System-Scope: None Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: User-Agent: python-urllib3/1.26.12 Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Auth-Token: gAAAAABjEq_Hp85Ji5ahqSYGHPznqTsZqVBFpN4oM1k2zvkbtf37dFWD8C2gxNwIGt-SUBSNk-I4d2ndeBN9lbJOx2zaFhOZ-ObQEcrEMW1lOy4rr-oQyR8vk6SrWdWl-JNU1u7lEvdcfJiLXCflwmcVT_Umh8mp6q6att8j6FuGyhkuxZ9CF-M Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Id: None Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Domain-Name: None Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Identity-Status: Confirmed Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Is-Admin-Project: True Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Id: default Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Domain-Name: Default Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Id: c306d09e93584320b34697dba7641ac8 Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Project-Name: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Role: member,reader Sep 03 01:44:59.009483 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Roles: member,reader Sep 03 01:44:59.011268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c306d09e93584320b34697dba7641ac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c306d09e93584320b34697dba7641ac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c306d09e93584320b34697dba7641ac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c306d09e93584320b34697dba7641ac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:44:59.011268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:44:59.011268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Id: c306d09e93584320b34697dba7641ac8 Sep 03 01:44:59.011268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:44:59.011268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User: tempest-TestVolumeBootPattern-1645626888-project Sep 03 01:44:59.011268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Id: default Sep 03 01:44:59.011268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Domain-Name: Default Sep 03 01:44:59.011268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Id: df0ffa9f450642cc94ed828cb34034b5 Sep 03 01:44:59.011268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: X-User-Name: tempest-TestVolumeBootPattern-1645626888-project Sep 03 01:44:59.011268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: method: > Sep 03 01:44:59.011268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: exception: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:44:59.011268 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: action_args: {'id': '843467ed-5454-46d9-8626-619ff8f27fd9'} Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:44:59.012248 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:44:59.013914 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR nova.api.openstack.wsgi Sep 03 01:44:59.015745 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9f92c6fb-bb6a-47df-96bf-d5883e48109e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Returning 404 to user: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. {{(pid=127552) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:44:59.015745 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9f92c6fb-bb6a-47df-96bf-d5883e48109e tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "DELETE /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 404 len: 111 microversion: 2.1 time: 0.030247 Sep 03 01:44:59.015745 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 647/1265] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:44:58 2022] DELETE /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:44:59.019516 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a97ebc4b-8832-499f-aafb-14d04d361e85 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:44:59.020117 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a97ebc4b-8832-499f-aafb-14d04d361e85 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] [instance: 843467ed-5454-46d9-8626-619ff8f27fd9] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:44:59.026626 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a97ebc4b-8832-499f-aafb-14d04d361e85 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:59.027103 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a97ebc4b-8832-499f-aafb-14d04d361e85 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:59.027536 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a97ebc4b-8832-499f-aafb-14d04d361e85 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:59.028219 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a97ebc4b-8832-499f-aafb-14d04d361e85 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:44:59.028880 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a97ebc4b-8832-499f-aafb-14d04d361e85 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:44:59.029299 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a97ebc4b-8832-499f-aafb-14d04d361e85 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:44:59.043818 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-a97ebc4b-8832-499f-aafb-14d04d361e85 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] HTTP exception thrown: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a97ebc4b-8832-499f-aafb-14d04d361e85 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Request method failure captured: Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 HTTP/1.1 Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjEq_Hp85Ji5ahqSYGHPznqTsZqVBFpN4oM1k2zvkbtf37dFWD8C2gxNwIGt-SUBSNk-I4d2ndeBN9lbJOx2zaFhOZ-ObQEcrEMW1lOy4rr-oQyR8vk6SrWdWl-JNU1u7lEvdcfJiLXCflwmcVT_Umh8mp6q6att8j6FuGyhkuxZ9CF-M Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: c306d09e93584320b34697dba7641ac8 Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:44:59.045338 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:44:59.047101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c306d09e93584320b34697dba7641ac8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c306d09e93584320b34697dba7641ac8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c306d09e93584320b34697dba7641ac8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c306d09e93584320b34697dba7641ac8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:44:59.047101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:44:59.047101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: c306d09e93584320b34697dba7641ac8 Sep 03 01:44:59.047101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-TestVolumeBootPattern-1645626888 Sep 03 01:44:59.047101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-TestVolumeBootPattern-1645626888-project Sep 03 01:44:59.047101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:44:59.047101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:44:59.047101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: df0ffa9f450642cc94ed828cb34034b5 Sep 03 01:44:59.047101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-TestVolumeBootPattern-1645626888-project Sep 03 01:44:59.047101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:44:59.047101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:44:59.047101 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': '843467ed-5454-46d9-8626-619ff8f27fd9'} Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:44:59.048102 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. Sep 03 01:44:59.049701 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:44:59.051104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a97ebc4b-8832-499f-aafb-14d04d361e85 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Returning 404 to user: Instance 843467ed-5454-46d9-8626-619ff8f27fd9 could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:44:59.051104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a97ebc4b-8832-499f-aafb-14d04d361e85 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9" status: 404 len: 111 microversion: 2.1 time: 0.030998 Sep 03 01:44:59.051104 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 619/1266] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:44:59 2022] GET /compute/v2.1/servers/843467ed-5454-46d9-8626-619ff8f27fd9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:45:00.568586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-babebcea-337e-422a-b761-ed82bf1b1614 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] Calling method '.version_select at 0x7f6d248631f0>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:45:00.713809 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-babebcea-337e-422a-b761-ed82bf1b1614 tempest-TestVolumeBootPattern-1645626888 tempest-TestVolumeBootPattern-1645626888-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-467180834" status: 202 len: 0 microversion: 2.1 time: 0.149169 Sep 03 01:45:00.714636 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 648/1267] 10.222.0.13 () {58 vars in 1260 bytes} [Sat Sep 3 01:45:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-467180834 => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:46:12.613982 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:46:12.614750 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:46:12.615843 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 01:46:12.615985 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Sat Sep 3 01:46:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd/action (ip 10.222.0.13) !!! Sep 03 01:46:12.626620 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-f997a844-00c4-4f22-a105-89ae8b38fb23 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:46:12.637713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-f997a844-00c4-4f22-a105-89ae8b38fb23 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:12.637713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f997a844-00c4-4f22-a105-89ae8b38fb23 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:12.637713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f997a844-00c4-4f22-a105-89ae8b38fb23 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:12.637713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f997a844-00c4-4f22-a105-89ae8b38fb23 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:12.638145 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f997a844-00c4-4f22-a105-89ae8b38fb23 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:12.638145 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f997a844-00c4-4f22-a105-89ae8b38fb23 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:12.638145 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-f997a844-00c4-4f22-a105-89ae8b38fb23 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:12.661692 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.objects.instance [None req-f997a844-00c4-4f22-a105-89ae8b38fb23 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lazy-loading 'flavor' on Instance uuid fce8f86d-7223-40db-9d53-68e5b4a309cd {{(pid=127553) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:46:13.046434 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-f997a844-00c4-4f22-a105-89ae8b38fb23 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "POST /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd/action" status: 202 len: 0 microversion: 2.1 time: 0.434047 Sep 03 01:46:13.047065 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 620/1268] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:46:12 2022] POST /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd/action => generated 0 bytes in 435 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:46:13.053646 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=38 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:46:13.054415 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:46:13.057621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 03 01:46:13.058023 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Sat Sep 3 01:46:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd (ip 10.222.0.13) !!! Sep 03 01:46:13.064203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-daa356d8-c0e9-4cd8-a481-9cb610da865c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:13.064836 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-daa356d8-c0e9-4cd8-a481-9cb610da865c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:13.072951 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-daa356d8-c0e9-4cd8-a481-9cb610da865c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:13.075013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-daa356d8-c0e9-4cd8-a481-9cb610da865c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:13.075013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-daa356d8-c0e9-4cd8-a481-9cb610da865c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:13.075013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-daa356d8-c0e9-4cd8-a481-9cb610da865c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:13.075013 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-daa356d8-c0e9-4cd8-a481-9cb610da865c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:13.075520 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-daa356d8-c0e9-4cd8-a481-9cb610da865c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:13.210971 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-daa356d8-c0e9-4cd8-a481-9cb610da865c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:13.219112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-daa356d8-c0e9-4cd8-a481-9cb610da865c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.167664 Sep 03 01:46:13.219680 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 649/1269] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:13 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:14.245641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ad1ea2ce-0064-45ff-8165-dbe558de8329 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:14.246283 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ad1ea2ce-0064-45ff-8165-dbe558de8329 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:14.253256 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ad1ea2ce-0064-45ff-8165-dbe558de8329 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:14.253736 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ad1ea2ce-0064-45ff-8165-dbe558de8329 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:14.254165 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ad1ea2ce-0064-45ff-8165-dbe558de8329 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:14.254905 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ad1ea2ce-0064-45ff-8165-dbe558de8329 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:14.255354 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ad1ea2ce-0064-45ff-8165-dbe558de8329 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:14.255769 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ad1ea2ce-0064-45ff-8165-dbe558de8329 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:14.387018 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-ad1ea2ce-0064-45ff-8165-dbe558de8329 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:14.394790 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ad1ea2ce-0064-45ff-8165-dbe558de8329 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.154029 Sep 03 01:46:14.395362 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 621/1270] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:14 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:15.418501 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a0cac1a2-e4ef-4e04-bb3d-3145a92221fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:15.419122 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a0cac1a2-e4ef-4e04-bb3d-3145a92221fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:15.425579 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0cac1a2-e4ef-4e04-bb3d-3145a92221fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:15.426056 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0cac1a2-e4ef-4e04-bb3d-3145a92221fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:15.426521 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0cac1a2-e4ef-4e04-bb3d-3145a92221fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:15.427197 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0cac1a2-e4ef-4e04-bb3d-3145a92221fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:15.427643 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0cac1a2-e4ef-4e04-bb3d-3145a92221fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:15.428060 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a0cac1a2-e4ef-4e04-bb3d-3145a92221fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:15.556725 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a0cac1a2-e4ef-4e04-bb3d-3145a92221fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:15.564290 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a0cac1a2-e4ef-4e04-bb3d-3145a92221fa tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.150311 Sep 03 01:46:15.564858 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 650/1271] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:15 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:16.588684 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-7ef7e206-9bb3-4934-86a5-0c27819941bd tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:16.589368 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-7ef7e206-9bb3-4934-86a5-0c27819941bd tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:16.595794 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7ef7e206-9bb3-4934-86a5-0c27819941bd tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:16.596280 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7ef7e206-9bb3-4934-86a5-0c27819941bd tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:16.596709 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7ef7e206-9bb3-4934-86a5-0c27819941bd tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:16.597418 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7ef7e206-9bb3-4934-86a5-0c27819941bd tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:16.597867 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7ef7e206-9bb3-4934-86a5-0c27819941bd tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:16.598324 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-7ef7e206-9bb3-4934-86a5-0c27819941bd tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:16.729934 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-7ef7e206-9bb3-4934-86a5-0c27819941bd tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:16.737622 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-7ef7e206-9bb3-4934-86a5-0c27819941bd tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.153421 Sep 03 01:46:16.738180 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 622/1272] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:16 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:17.761137 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7778d0e4-8280-4df4-b938-fa8a5a0a1342 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:17.761750 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7778d0e4-8280-4df4-b938-fa8a5a0a1342 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:17.768114 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7778d0e4-8280-4df4-b938-fa8a5a0a1342 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:17.768591 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7778d0e4-8280-4df4-b938-fa8a5a0a1342 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:17.769022 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7778d0e4-8280-4df4-b938-fa8a5a0a1342 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:17.769700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7778d0e4-8280-4df4-b938-fa8a5a0a1342 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:17.770143 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7778d0e4-8280-4df4-b938-fa8a5a0a1342 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:17.770586 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7778d0e4-8280-4df4-b938-fa8a5a0a1342 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:17.904651 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7778d0e4-8280-4df4-b938-fa8a5a0a1342 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:17.912710 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7778d0e4-8280-4df4-b938-fa8a5a0a1342 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.155339 Sep 03 01:46:17.913274 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 651/1273] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:17 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:18.937167 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-a617cbe1-d762-44ea-b568-d87ca00c6ebb tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:18.937778 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-a617cbe1-d762-44ea-b568-d87ca00c6ebb tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:18.946121 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a617cbe1-d762-44ea-b568-d87ca00c6ebb tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:18.947258 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a617cbe1-d762-44ea-b568-d87ca00c6ebb tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:18.947698 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a617cbe1-d762-44ea-b568-d87ca00c6ebb tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:18.948380 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a617cbe1-d762-44ea-b568-d87ca00c6ebb tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:18.948830 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a617cbe1-d762-44ea-b568-d87ca00c6ebb tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:18.949252 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-a617cbe1-d762-44ea-b568-d87ca00c6ebb tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:19.075484 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-a617cbe1-d762-44ea-b568-d87ca00c6ebb tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:19.083106 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-a617cbe1-d762-44ea-b568-d87ca00c6ebb tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.149833 Sep 03 01:46:19.083679 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 623/1274] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:18 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:20.105884 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-a75ce50b-37cd-408a-aff9-3db25e98e913 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:20.106518 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-a75ce50b-37cd-408a-aff9-3db25e98e913 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:20.113030 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a75ce50b-37cd-408a-aff9-3db25e98e913 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:20.113545 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a75ce50b-37cd-408a-aff9-3db25e98e913 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:20.113981 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a75ce50b-37cd-408a-aff9-3db25e98e913 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:20.114703 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a75ce50b-37cd-408a-aff9-3db25e98e913 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:20.115155 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a75ce50b-37cd-408a-aff9-3db25e98e913 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:20.115580 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-a75ce50b-37cd-408a-aff9-3db25e98e913 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:20.243073 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-a75ce50b-37cd-408a-aff9-3db25e98e913 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:20.250887 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-a75ce50b-37cd-408a-aff9-3db25e98e913 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.149077 Sep 03 01:46:20.251458 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 652/1275] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:20 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:21.275801 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-01f7035a-6195-4c1e-ba73-8616a8528d13 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:21.276385 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-01f7035a-6195-4c1e-ba73-8616a8528d13 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:21.282711 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-01f7035a-6195-4c1e-ba73-8616a8528d13 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:21.283187 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-01f7035a-6195-4c1e-ba73-8616a8528d13 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:21.283617 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-01f7035a-6195-4c1e-ba73-8616a8528d13 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:21.284294 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-01f7035a-6195-4c1e-ba73-8616a8528d13 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:21.284741 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-01f7035a-6195-4c1e-ba73-8616a8528d13 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:21.285158 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-01f7035a-6195-4c1e-ba73-8616a8528d13 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:21.415673 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-01f7035a-6195-4c1e-ba73-8616a8528d13 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:21.423371 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-01f7035a-6195-4c1e-ba73-8616a8528d13 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.151831 Sep 03 01:46:21.423938 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 624/1276] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:21 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:46:22.447621 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-252abb53-0040-4e0c-8d06-1f65b72845c1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:22.448216 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-252abb53-0040-4e0c-8d06-1f65b72845c1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:22.454491 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-252abb53-0040-4e0c-8d06-1f65b72845c1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:22.455032 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-252abb53-0040-4e0c-8d06-1f65b72845c1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:22.455472 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-252abb53-0040-4e0c-8d06-1f65b72845c1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:22.456183 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-252abb53-0040-4e0c-8d06-1f65b72845c1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:22.456637 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-252abb53-0040-4e0c-8d06-1f65b72845c1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:22.457062 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-252abb53-0040-4e0c-8d06-1f65b72845c1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:22.589078 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-252abb53-0040-4e0c-8d06-1f65b72845c1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:22.596682 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-252abb53-0040-4e0c-8d06-1f65b72845c1 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.153639 Sep 03 01:46:22.597255 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 653/1277] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:22 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:23.619035 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-06cd3ae9-f503-4fd7-91cb-67ff7ca17e17 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:23.619656 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-06cd3ae9-f503-4fd7-91cb-67ff7ca17e17 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:23.626109 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-06cd3ae9-f503-4fd7-91cb-67ff7ca17e17 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:23.626957 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-06cd3ae9-f503-4fd7-91cb-67ff7ca17e17 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:23.627096 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-06cd3ae9-f503-4fd7-91cb-67ff7ca17e17 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:23.627750 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-06cd3ae9-f503-4fd7-91cb-67ff7ca17e17 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:23.628226 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-06cd3ae9-f503-4fd7-91cb-67ff7ca17e17 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:23.628612 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-06cd3ae9-f503-4fd7-91cb-67ff7ca17e17 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:23.848198 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-06cd3ae9-f503-4fd7-91cb-67ff7ca17e17 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:23.858482 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-06cd3ae9-f503-4fd7-91cb-67ff7ca17e17 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.243217 Sep 03 01:46:23.859113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 625/1278] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:23 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:24.881854 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-2fd8b6ec-3368-4a7e-813b-eeaf1968fdac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:24.884698 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-2fd8b6ec-3368-4a7e-813b-eeaf1968fdac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:24.889705 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2fd8b6ec-3368-4a7e-813b-eeaf1968fdac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:24.890195 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2fd8b6ec-3368-4a7e-813b-eeaf1968fdac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:24.890658 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2fd8b6ec-3368-4a7e-813b-eeaf1968fdac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:24.891399 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2fd8b6ec-3368-4a7e-813b-eeaf1968fdac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:24.891851 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2fd8b6ec-3368-4a7e-813b-eeaf1968fdac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:24.892304 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-2fd8b6ec-3368-4a7e-813b-eeaf1968fdac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:25.024865 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-2fd8b6ec-3368-4a7e-813b-eeaf1968fdac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:25.032640 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-2fd8b6ec-3368-4a7e-813b-eeaf1968fdac tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.154660 Sep 03 01:46:25.033205 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 654/1279] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:24 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:26.056168 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c41cc408-6d4f-4220-9505-89ac26ced08c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:26.056713 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c41cc408-6d4f-4220-9505-89ac26ced08c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:26.063274 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c41cc408-6d4f-4220-9505-89ac26ced08c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:26.063762 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c41cc408-6d4f-4220-9505-89ac26ced08c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:26.064212 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c41cc408-6d4f-4220-9505-89ac26ced08c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:26.064901 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c41cc408-6d4f-4220-9505-89ac26ced08c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:26.065356 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c41cc408-6d4f-4220-9505-89ac26ced08c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:26.065783 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c41cc408-6d4f-4220-9505-89ac26ced08c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:26.209131 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c41cc408-6d4f-4220-9505-89ac26ced08c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:26.217472 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c41cc408-6d4f-4220-9505-89ac26ced08c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.165314 Sep 03 01:46:26.218050 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 626/1280] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:26 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:27.240888 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-d22e80b3-b4e6-481f-a81e-8c79766af436 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:27.241495 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-d22e80b3-b4e6-481f-a81e-8c79766af436 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:27.248509 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d22e80b3-b4e6-481f-a81e-8c79766af436 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:27.248994 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d22e80b3-b4e6-481f-a81e-8c79766af436 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:27.249430 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d22e80b3-b4e6-481f-a81e-8c79766af436 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:27.250111 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d22e80b3-b4e6-481f-a81e-8c79766af436 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:27.250599 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d22e80b3-b4e6-481f-a81e-8c79766af436 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:27.251027 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-d22e80b3-b4e6-481f-a81e-8c79766af436 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:27.382839 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-d22e80b3-b4e6-481f-a81e-8c79766af436 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:27.391274 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-d22e80b3-b4e6-481f-a81e-8c79766af436 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1570 microversion: 2.1 time: 0.154237 Sep 03 01:46:27.391848 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 655/1281] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:27 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1570 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:27.416061 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ff4cb396-f426-42ce-aff7-96cac656587c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:46:27.421807 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ff4cb396-f426-42ce-aff7-96cac656587c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:27.423191 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff4cb396-f426-42ce-aff7-96cac656587c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:27.423680 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff4cb396-f426-42ce-aff7-96cac656587c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:27.424113 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff4cb396-f426-42ce-aff7-96cac656587c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:27.424807 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff4cb396-f426-42ce-aff7-96cac656587c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:27.425258 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff4cb396-f426-42ce-aff7-96cac656587c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:27.425685 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ff4cb396-f426-42ce-aff7-96cac656587c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:27.563259 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ff4cb396-f426-42ce-aff7-96cac656587c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127553) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 03 01:46:28.014575 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ff4cb396-f426-42ce-aff7-96cac656587c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "POST /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd/action" status: 202 len: 0 microversion: 2.1 time: 0.603053 Sep 03 01:46:28.015407 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 627/1282] 10.222.0.13 () {60 vars in 1278 bytes} [Sat Sep 3 01:46:27 2022] POST /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd/action => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 03 01:46:28.023169 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-b59133bc-3bfd-455e-b441-84bbea0f579a tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:28.023859 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-b59133bc-3bfd-455e-b441-84bbea0f579a tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:28.030552 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b59133bc-3bfd-455e-b441-84bbea0f579a tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:28.031055 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b59133bc-3bfd-455e-b441-84bbea0f579a tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:28.031477 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b59133bc-3bfd-455e-b441-84bbea0f579a tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:28.032214 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b59133bc-3bfd-455e-b441-84bbea0f579a tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:28.032666 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b59133bc-3bfd-455e-b441-84bbea0f579a tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:28.033089 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-b59133bc-3bfd-455e-b441-84bbea0f579a tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:28.167400 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-b59133bc-3bfd-455e-b441-84bbea0f579a tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:28.175137 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-b59133bc-3bfd-455e-b441-84bbea0f579a tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1518 microversion: 2.1 time: 0.155788 Sep 03 01:46:28.175709 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 656/1283] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:28 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:29.199119 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-66699d05-b458-466f-b0cb-cfc0c01d6b7e tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:29.199676 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-66699d05-b458-466f-b0cb-cfc0c01d6b7e tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:29.205643 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-66699d05-b458-466f-b0cb-cfc0c01d6b7e tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:29.206128 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-66699d05-b458-466f-b0cb-cfc0c01d6b7e tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:29.206593 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-66699d05-b458-466f-b0cb-cfc0c01d6b7e tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:29.207327 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-66699d05-b458-466f-b0cb-cfc0c01d6b7e tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:29.207780 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-66699d05-b458-466f-b0cb-cfc0c01d6b7e tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:29.208206 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-66699d05-b458-466f-b0cb-cfc0c01d6b7e tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:29.344211 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-66699d05-b458-466f-b0cb-cfc0c01d6b7e tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:29.352119 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-66699d05-b458-466f-b0cb-cfc0c01d6b7e tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1518 microversion: 2.1 time: 0.157540 Sep 03 01:46:29.353366 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 628/1284] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:29 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:29.445700 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-961ab291-9240-47dd-9486-42ff7269f87b req-538a03c7-8cd1-4f46-8ffe-42b9e56c2c73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce8f86d-7223-40db-9d53-68e5b4a309cd", "name": "network-vif-unplugged", "status": "completed", "tag": "79c632ec-1548-4d13-bffa-aae5dd768fa7"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:46:29.456237 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-961ab291-9240-47dd-9486-42ff7269f87b req-538a03c7-8cd1-4f46-8ffe-42b9e56c2c73 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:29.456711 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-961ab291-9240-47dd-9486-42ff7269f87b req-538a03c7-8cd1-4f46-8ffe-42b9e56c2c73 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:29.457138 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-961ab291-9240-47dd-9486-42ff7269f87b req-538a03c7-8cd1-4f46-8ffe-42b9e56c2c73 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:29.469043 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.compute.server_external_events [req-961ab291-9240-47dd-9486-42ff7269f87b req-538a03c7-8cd1-4f46-8ffe-42b9e56c2c73 service nova] Unable to find a host for instance fce8f86d-7223-40db-9d53-68e5b4a309cd. Dropping event network-vif-unplugged {{(pid=127552) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 03 01:46:29.469922 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-961ab291-9240-47dd-9486-42ff7269f87b req-538a03c7-8cd1-4f46-8ffe-42b9e56c2c73 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028033 Sep 03 01:46:29.470542 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 657/1285] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:46:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 03 01:46:30.377224 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-c2a0584c-7e95-4b8e-b318-790b4f406e89 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:30.377769 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-c2a0584c-7e95-4b8e-b318-790b4f406e89 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:30.384380 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c2a0584c-7e95-4b8e-b318-790b4f406e89 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:30.384861 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c2a0584c-7e95-4b8e-b318-790b4f406e89 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:30.385291 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c2a0584c-7e95-4b8e-b318-790b4f406e89 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:30.385972 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c2a0584c-7e95-4b8e-b318-790b4f406e89 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:30.386450 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c2a0584c-7e95-4b8e-b318-790b4f406e89 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:30.386873 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-c2a0584c-7e95-4b8e-b318-790b4f406e89 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:30.526992 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-c2a0584c-7e95-4b8e-b318-790b4f406e89 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:30.534753 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-c2a0584c-7e95-4b8e-b318-790b4f406e89 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1520 microversion: 2.1 time: 0.161510 Sep 03 01:46:30.535333 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 629/1286] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:30 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:31.559073 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-cd2594b9-f2fa-4c7f-b74d-64f93f70dd35 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:31.559687 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-cd2594b9-f2fa-4c7f-b74d-64f93f70dd35 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:31.565773 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd2594b9-f2fa-4c7f-b74d-64f93f70dd35 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:31.566259 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd2594b9-f2fa-4c7f-b74d-64f93f70dd35 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:31.566724 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd2594b9-f2fa-4c7f-b74d-64f93f70dd35 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:31.567416 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd2594b9-f2fa-4c7f-b74d-64f93f70dd35 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:31.567877 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd2594b9-f2fa-4c7f-b74d-64f93f70dd35 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:31.568304 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-cd2594b9-f2fa-4c7f-b74d-64f93f70dd35 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:31.701582 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-cd2594b9-f2fa-4c7f-b74d-64f93f70dd35 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:31.709476 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-cd2594b9-f2fa-4c7f-b74d-64f93f70dd35 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1576 microversion: 2.1 time: 0.155024 Sep 03 01:46:31.710057 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 658/1287] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:31 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:32.733144 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-d35afb0a-80be-41c8-805f-0fca3d901ad9 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:32.733790 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-d35afb0a-80be-41c8-805f-0fca3d901ad9 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:32.740199 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d35afb0a-80be-41c8-805f-0fca3d901ad9 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:32.740686 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d35afb0a-80be-41c8-805f-0fca3d901ad9 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:32.741128 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d35afb0a-80be-41c8-805f-0fca3d901ad9 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:32.741815 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d35afb0a-80be-41c8-805f-0fca3d901ad9 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:32.742275 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d35afb0a-80be-41c8-805f-0fca3d901ad9 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:32.742724 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-d35afb0a-80be-41c8-805f-0fca3d901ad9 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:32.874535 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-d35afb0a-80be-41c8-805f-0fca3d901ad9 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:32.882221 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-d35afb0a-80be-41c8-805f-0fca3d901ad9 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1576 microversion: 2.1 time: 0.153096 Sep 03 01:46:32.882821 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 630/1288] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:32 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:33.906235 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-746ba1f2-c805-4a92-a72d-323891a8200b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:33.906874 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-746ba1f2-c805-4a92-a72d-323891a8200b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:33.913506 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-746ba1f2-c805-4a92-a72d-323891a8200b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:33.913979 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-746ba1f2-c805-4a92-a72d-323891a8200b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:33.914507 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-746ba1f2-c805-4a92-a72d-323891a8200b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:33.916009 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-746ba1f2-c805-4a92-a72d-323891a8200b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:33.916461 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-746ba1f2-c805-4a92-a72d-323891a8200b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:33.916881 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-746ba1f2-c805-4a92-a72d-323891a8200b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:34.053587 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-746ba1f2-c805-4a92-a72d-323891a8200b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:34.061545 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-746ba1f2-c805-4a92-a72d-323891a8200b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1576 microversion: 2.1 time: 0.159192 Sep 03 01:46:34.062052 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 659/1289] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:33 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:35.083982 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-72d6e98e-0f74-4a9e-8a19-033a0eddcbda tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:35.084528 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-72d6e98e-0f74-4a9e-8a19-033a0eddcbda tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:35.087366 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 01:46:35.087520 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Sat Sep 3 01:46:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd (ip 10.222.0.13) !!! Sep 03 01:46:35.093655 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-72d6e98e-0f74-4a9e-8a19-033a0eddcbda tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:35.094130 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-72d6e98e-0f74-4a9e-8a19-033a0eddcbda tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:35.094641 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-72d6e98e-0f74-4a9e-8a19-033a0eddcbda tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:35.095361 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-72d6e98e-0f74-4a9e-8a19-033a0eddcbda tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:35.095858 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-72d6e98e-0f74-4a9e-8a19-033a0eddcbda tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:35.096290 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-72d6e98e-0f74-4a9e-8a19-033a0eddcbda tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:35.228509 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-72d6e98e-0f74-4a9e-8a19-033a0eddcbda tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:35.236207 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-72d6e98e-0f74-4a9e-8a19-033a0eddcbda tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1576 microversion: 2.1 time: 0.156193 Sep 03 01:46:35.236776 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 631/1290] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:35 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:36.259532 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7e9e2b96-f6a8-4c0f-b528-0e299ae2d4db tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:36.260177 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7e9e2b96-f6a8-4c0f-b528-0e299ae2d4db tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:36.267047 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e9e2b96-f6a8-4c0f-b528-0e299ae2d4db tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:36.267535 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e9e2b96-f6a8-4c0f-b528-0e299ae2d4db tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:36.267978 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e9e2b96-f6a8-4c0f-b528-0e299ae2d4db tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:36.268670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e9e2b96-f6a8-4c0f-b528-0e299ae2d4db tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:36.269122 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e9e2b96-f6a8-4c0f-b528-0e299ae2d4db tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:36.269542 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7e9e2b96-f6a8-4c0f-b528-0e299ae2d4db tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:36.404103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7e9e2b96-f6a8-4c0f-b528-0e299ae2d4db tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:36.411980 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7e9e2b96-f6a8-4c0f-b528-0e299ae2d4db tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1576 microversion: 2.1 time: 0.156338 Sep 03 01:46:36.412848 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 660/1291] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:36 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:37.435872 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-6160cdb4-2bb4-4ce9-858b-e20d85726d2b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:37.436476 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-6160cdb4-2bb4-4ce9-858b-e20d85726d2b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:37.443039 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6160cdb4-2bb4-4ce9-858b-e20d85726d2b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:37.443521 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6160cdb4-2bb4-4ce9-858b-e20d85726d2b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:37.443957 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6160cdb4-2bb4-4ce9-858b-e20d85726d2b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:37.445237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6160cdb4-2bb4-4ce9-858b-e20d85726d2b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:37.445237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6160cdb4-2bb4-4ce9-858b-e20d85726d2b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:37.445668 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-6160cdb4-2bb4-4ce9-858b-e20d85726d2b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:37.576879 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-6160cdb4-2bb4-4ce9-858b-e20d85726d2b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:37.584417 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-6160cdb4-2bb4-4ce9-858b-e20d85726d2b tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1576 microversion: 2.1 time: 0.152480 Sep 03 01:46:37.584980 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 632/1292] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:37 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 03 01:46:38.607276 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9fdeda3a-5086-432c-adbe-1d0a96bfc8bf tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:38.607887 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9fdeda3a-5086-432c-adbe-1d0a96bfc8bf tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:38.614287 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9fdeda3a-5086-432c-adbe-1d0a96bfc8bf tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:38.614796 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9fdeda3a-5086-432c-adbe-1d0a96bfc8bf tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:38.615230 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9fdeda3a-5086-432c-adbe-1d0a96bfc8bf tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:38.615912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9fdeda3a-5086-432c-adbe-1d0a96bfc8bf tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:38.616426 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9fdeda3a-5086-432c-adbe-1d0a96bfc8bf tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:38.616854 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9fdeda3a-5086-432c-adbe-1d0a96bfc8bf tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:38.746101 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9fdeda3a-5086-432c-adbe-1d0a96bfc8bf tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:38.753670 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9fdeda3a-5086-432c-adbe-1d0a96bfc8bf tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1576 microversion: 2.1 time: 0.150286 Sep 03 01:46:38.754238 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 661/1293] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:38 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1576 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:39.777579 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-2356e501-06c6-4225-9784-c26e92dd8f15 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:39.778192 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-2356e501-06c6-4225-9784-c26e92dd8f15 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:39.784597 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2356e501-06c6-4225-9784-c26e92dd8f15 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:39.785079 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2356e501-06c6-4225-9784-c26e92dd8f15 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:39.785517 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2356e501-06c6-4225-9784-c26e92dd8f15 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:39.786200 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2356e501-06c6-4225-9784-c26e92dd8f15 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:39.786675 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2356e501-06c6-4225-9784-c26e92dd8f15 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:39.787100 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-2356e501-06c6-4225-9784-c26e92dd8f15 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:39.806159 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:46:39.918172 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-2356e501-06c6-4225-9784-c26e92dd8f15 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:39.925932 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-2356e501-06c6-4225-9784-c26e92dd8f15 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1576 microversion: 2.1 time: 0.152855 Sep 03 01:46:39.926524 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 633/1294] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:39 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:40.949813 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-7d4c1e00-c69e-4400-9ff8-1e3edbc13129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:40.950451 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-7d4c1e00-c69e-4400-9ff8-1e3edbc13129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:40.956941 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7d4c1e00-c69e-4400-9ff8-1e3edbc13129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:40.957426 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7d4c1e00-c69e-4400-9ff8-1e3edbc13129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:40.957871 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7d4c1e00-c69e-4400-9ff8-1e3edbc13129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:40.958589 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7d4c1e00-c69e-4400-9ff8-1e3edbc13129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:40.959046 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7d4c1e00-c69e-4400-9ff8-1e3edbc13129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:40.959475 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-7d4c1e00-c69e-4400-9ff8-1e3edbc13129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:41.092655 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-7d4c1e00-c69e-4400-9ff8-1e3edbc13129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:41.100332 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-7d4c1e00-c69e-4400-9ff8-1e3edbc13129 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1576 microversion: 2.1 time: 0.155186 Sep 03 01:46:41.100908 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 662/1295] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:40 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:41.563398 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [req-767007df-b3e4-4ad9-9129-ca524a217eff req-b099b5bb-94d4-41d1-91a9-c35fbbeb8e6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce8f86d-7223-40db-9d53-68e5b4a309cd", "name": "network-vif-plugged", "status": "completed", "tag": "79c632ec-1548-4d13-bffa-aae5dd768fa7"}]} {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:46:41.573049 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-767007df-b3e4-4ad9-9129-ca524a217eff req-b099b5bb-94d4-41d1-91a9-c35fbbeb8e6b service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:41.573519 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-767007df-b3e4-4ad9-9129-ca524a217eff req-b099b5bb-94d4-41d1-91a9-c35fbbeb8e6b service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:41.573944 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [req-767007df-b3e4-4ad9-9129-ca524a217eff req-b099b5bb-94d4-41d1-91a9-c35fbbeb8e6b service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:41.584613 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.compute.server_external_events [req-767007df-b3e4-4ad9-9129-ca524a217eff req-b099b5bb-94d4-41d1-91a9-c35fbbeb8e6b service nova] Creating event network-vif-plugged:79c632ec-1548-4d13-bffa-aae5dd768fa7 for instance fce8f86d-7223-40db-9d53-68e5b4a309cd on hv-cinder-83800 Sep 03 01:46:41.590885 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [req-767007df-b3e4-4ad9-9129-ca524a217eff req-b099b5bb-94d4-41d1-91a9-c35fbbeb8e6b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030931 Sep 03 01:46:41.591462 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 634/1296] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:46:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:46:42.125143 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-85a5e134-7be7-4051-94dd-5c5e7bdcb659 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:42.125764 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-85a5e134-7be7-4051-94dd-5c5e7bdcb659 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:42.132273 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-85a5e134-7be7-4051-94dd-5c5e7bdcb659 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:42.132753 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-85a5e134-7be7-4051-94dd-5c5e7bdcb659 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:42.133787 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-85a5e134-7be7-4051-94dd-5c5e7bdcb659 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:42.134505 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-85a5e134-7be7-4051-94dd-5c5e7bdcb659 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:42.135047 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-85a5e134-7be7-4051-94dd-5c5e7bdcb659 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:42.135471 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-85a5e134-7be7-4051-94dd-5c5e7bdcb659 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:42.265915 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-85a5e134-7be7-4051-94dd-5c5e7bdcb659 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:42.273691 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-85a5e134-7be7-4051-94dd-5c5e7bdcb659 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1576 microversion: 2.1 time: 0.152567 Sep 03 01:46:42.274269 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 663/1297] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:42 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:43.297749 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-4bff06a1-a941-46f0-86b7-1fee625adfb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:43.298530 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-4bff06a1-a941-46f0-86b7-1fee625adfb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:43.300905 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:46:43.306414 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4bff06a1-a941-46f0-86b7-1fee625adfb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:43.306898 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4bff06a1-a941-46f0-86b7-1fee625adfb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:43.307333 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4bff06a1-a941-46f0-86b7-1fee625adfb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:43.308020 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4bff06a1-a941-46f0-86b7-1fee625adfb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:43.308470 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4bff06a1-a941-46f0-86b7-1fee625adfb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:43.308894 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-4bff06a1-a941-46f0-86b7-1fee625adfb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:43.441291 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-4bff06a1-a941-46f0-86b7-1fee625adfb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:43.449605 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-4bff06a1-a941-46f0-86b7-1fee625adfb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1576 microversion: 2.1 time: 0.156136 Sep 03 01:46:43.451157 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 635/1298] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:43 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:46:44.473539 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-9b4fbd21-672a-41de-a1e5-f117a962a564 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:46:44.474178 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-9b4fbd21-672a-41de-a1e5-f117a962a564 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:46:44.480804 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9b4fbd21-672a-41de-a1e5-f117a962a564 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:44.481289 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9b4fbd21-672a-41de-a1e5-f117a962a564 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:44.481726 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9b4fbd21-672a-41de-a1e5-f117a962a564 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:44.482451 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9b4fbd21-672a-41de-a1e5-f117a962a564 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:46:44.482912 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9b4fbd21-672a-41de-a1e5-f117a962a564 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:46:44.483339 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-9b4fbd21-672a-41de-a1e5-f117a962a564 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:46:44.485861 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=87 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:46:44.614477 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-9b4fbd21-672a-41de-a1e5-f117a962a564 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:46:44.622658 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-9b4fbd21-672a-41de-a1e5-f117a962a564 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1563 microversion: 2.1 time: 0.153005 Sep 03 01:46:44.623227 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 664/1299] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:46:44 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1563 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:47:58.342200 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR oslo.messaging._drivers.impl_rabbit [-] [f0af1133-1449-4dfa-bd7f-daa92adccdea] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 03 01:47:58.345365 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_api:SELECT=32 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:47:58.346112 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG dbcounter [-] [127552] Writing DB stats nova_cell1:SELECT=5 {{(pid=127552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:47:58.346238 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-88f7dbfb-7eaf-42d2-aebe-e802cb3e4fb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:47:58.346779 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-88f7dbfb-7eaf-42d2-aebe-e802cb3e4fb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:47:58.347162 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 03 01:47:58.347335 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: Sat Sep 3 01:47:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.13) !!! Sep 03 01:47:58.350704 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_api:SELECT=1 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:47:58.351991 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG dbcounter [-] [127553] Writing DB stats nova_cell1:SELECT=10 {{(pid=127553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 03 01:47:58.357985 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-88f7dbfb-7eaf-42d2-aebe-e802cb3e4fb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:47:58.360223 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-88f7dbfb-7eaf-42d2-aebe-e802cb3e4fb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:47:58.360223 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-88f7dbfb-7eaf-42d2-aebe-e802cb3e4fb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:47:58.360223 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-88f7dbfb-7eaf-42d2-aebe-e802cb3e4fb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:47:58.360521 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-83212cc6-1a89-4ed0-b0f6-7e16d536ceac req-214499ca-91f6-46b9-9ea0-5d673e4a9405 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce8f86d-7223-40db-9d53-68e5b4a309cd", "tag": "79c632ec-1548-4d13-bffa-aae5dd768fa7"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:47:58.360634 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-88f7dbfb-7eaf-42d2-aebe-e802cb3e4fb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:47:58.360730 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-88f7dbfb-7eaf-42d2-aebe-e802cb3e4fb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:47:58.371029 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-83212cc6-1a89-4ed0-b0f6-7e16d536ceac req-214499ca-91f6-46b9-9ea0-5d673e4a9405 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:47:58.371511 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-83212cc6-1a89-4ed0-b0f6-7e16d536ceac req-214499ca-91f6-46b9-9ea0-5d673e4a9405 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:47:58.371994 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-83212cc6-1a89-4ed0-b0f6-7e16d536ceac req-214499ca-91f6-46b9-9ea0-5d673e4a9405 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:47:58.384093 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-83212cc6-1a89-4ed0-b0f6-7e16d536ceac req-214499ca-91f6-46b9-9ea0-5d673e4a9405 service nova] Creating event network-changed:79c632ec-1548-4d13-bffa-aae5dd768fa7 for instance fce8f86d-7223-40db-9d53-68e5b4a309cd on hv-cinder-83800 Sep 03 01:47:58.387646 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-88f7dbfb-7eaf-42d2-aebe-e802cb3e4fb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Going to try to terminate instance {{(pid=127553) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 03 01:47:58.393103 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: ERROR oslo.messaging._drivers.impl_rabbit [req-83212cc6-1a89-4ed0-b0f6-7e16d536ceac req-214499ca-91f6-46b9-9ea0-5d673e4a9405 service nova] [800a95c6-d7aa-4bbb-9abc-655767039363] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 03 01:47:58.723968 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-88f7dbfb-7eaf-42d2-aebe-e802cb3e4fb3 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 204 len: 0 microversion: 2.1 time: 0.383512 Sep 03 01:47:58.724566 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 636/1300] 10.222.0.13 () {58 vars in 1239 bytes} [Sat Sep 3 01:47:58 2022] DELETE /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 03 01:47:58.733981 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-3eb49f75-1e81-4a0d-91e8-3b9ef46fa069 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:47:58.734694 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-3eb49f75-1e81-4a0d-91e8-3b9ef46fa069 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:47:58.740706 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3eb49f75-1e81-4a0d-91e8-3b9ef46fa069 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:47:58.741331 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3eb49f75-1e81-4a0d-91e8-3b9ef46fa069 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:47:58.741770 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3eb49f75-1e81-4a0d-91e8-3b9ef46fa069 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:47:58.742494 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3eb49f75-1e81-4a0d-91e8-3b9ef46fa069 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:47:58.742944 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3eb49f75-1e81-4a0d-91e8-3b9ef46fa069 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:47:58.743366 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-3eb49f75-1e81-4a0d-91e8-3b9ef46fa069 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:47:58.940401 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-3eb49f75-1e81-4a0d-91e8-3b9ef46fa069 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:47:58.948945 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-3eb49f75-1e81-4a0d-91e8-3b9ef46fa069 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.219603 Sep 03 01:47:58.949545 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 637/1301] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:47:58 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:47:59.396812 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO oslo.messaging._drivers.impl_rabbit [req-83212cc6-1a89-4ed0-b0f6-7e16d536ceac req-214499ca-91f6-46b9-9ea0-5d673e4a9405 service nova] [800a95c6-d7aa-4bbb-9abc-655767039363] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54540. Sep 03 01:47:59.400077 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-83212cc6-1a89-4ed0-b0f6-7e16d536ceac req-214499ca-91f6-46b9-9ea0-5d673e4a9405 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.057450 Sep 03 01:47:59.400684 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 665/1302] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:47:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 03 01:47:59.973000 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-247a4ac5-bdb3-402e-b7f6-0f86e2b0d2df tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:47:59.973606 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-247a4ac5-bdb3-402e-b7f6-0f86e2b0d2df tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:47:59.985218 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO oslo.messaging._drivers.impl_rabbit [-] [f0af1133-1449-4dfa-bd7f-daa92adccdea] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 54544. Sep 03 01:47:59.989380 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-247a4ac5-bdb3-402e-b7f6-0f86e2b0d2df tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:47:59.989870 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-247a4ac5-bdb3-402e-b7f6-0f86e2b0d2df tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:47:59.990311 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-247a4ac5-bdb3-402e-b7f6-0f86e2b0d2df tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:47:59.991062 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-247a4ac5-bdb3-402e-b7f6-0f86e2b0d2df tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:47:59.991520 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-247a4ac5-bdb3-402e-b7f6-0f86e2b0d2df tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:47:59.991944 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-247a4ac5-bdb3-402e-b7f6-0f86e2b0d2df tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:48:00.221071 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-247a4ac5-bdb3-402e-b7f6-0f86e2b0d2df tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:48:00.228927 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-247a4ac5-bdb3-402e-b7f6-0f86e2b0d2df tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1569 microversion: 2.1 time: 0.259899 Sep 03 01:48:00.230028 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 638/1303] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:47:59 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1569 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:48:01.062824 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [req-4c800afe-a0a9-4aa3-b1bd-91eee7dde60f req-4e346dac-9e14-4195-bb85-0c36e6bac266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce8f86d-7223-40db-9d53-68e5b4a309cd", "name": "network-vif-deleted", "tag": "79c632ec-1548-4d13-bffa-aae5dd768fa7"}]} {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 03 01:48:01.072099 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-4c800afe-a0a9-4aa3-b1bd-91eee7dde60f req-4e346dac-9e14-4195-bb85-0c36e6bac266 service nova] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:48:01.072574 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-4c800afe-a0a9-4aa3-b1bd-91eee7dde60f req-4e346dac-9e14-4195-bb85-0c36e6bac266 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:48:01.073647 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [req-4c800afe-a0a9-4aa3-b1bd-91eee7dde60f req-4e346dac-9e14-4195-bb85-0c36e6bac266 service nova] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:48:01.084554 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.compute.server_external_events [req-4c800afe-a0a9-4aa3-b1bd-91eee7dde60f req-4e346dac-9e14-4195-bb85-0c36e6bac266 service nova] Creating event network-vif-deleted:79c632ec-1548-4d13-bffa-aae5dd768fa7 for instance fce8f86d-7223-40db-9d53-68e5b4a309cd on hv-cinder-83800 Sep 03 01:48:01.090199 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [req-4c800afe-a0a9-4aa3-b1bd-91eee7dde60f req-4e346dac-9e14-4195-bb85-0c36e6bac266 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031753 Sep 03 01:48:01.090827 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 666/1304] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Sep 3 01:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 03 01:48:01.253203 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-0dea8657-2600-4a96-b582-2587226401ce tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:48:01.253811 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-0dea8657-2600-4a96-b582-2587226401ce tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:48:01.261142 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0dea8657-2600-4a96-b582-2587226401ce tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:48:01.261584 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0dea8657-2600-4a96-b582-2587226401ce tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:48:01.262024 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0dea8657-2600-4a96-b582-2587226401ce tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:48:01.262753 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0dea8657-2600-4a96-b582-2587226401ce tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:48:01.263210 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0dea8657-2600-4a96-b582-2587226401ce tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:48:01.263638 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-0dea8657-2600-4a96-b582-2587226401ce tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:48:01.333455 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.policy [None req-0dea8657-2600-4a96-b582-2587226401ce tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127553) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:48:01.342400 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-0dea8657-2600-4a96-b582-2587226401ce tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1220 microversion: 2.1 time: 0.093069 Sep 03 01:48:01.342996 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 639/1305] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:48:01 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1220 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:48:02.366134 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:48:02.368228 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.compute.api [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127552) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:48:02.373719 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:48:02.374203 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:48:02.374660 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:48:02.375347 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:48:02.375806 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:48:02.376226 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:48:02.406408 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:48:02.406888 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:48:02.407322 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG oslo_concurrency.lockutils [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127552) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:48:02.407760 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.objects.instance [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lazy-loading 'fault' on Instance uuid fce8f86d-7223-40db-9d53-68e5b4a309cd {{(pid=127552) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 03 01:48:02.506194 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.policy [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ebb858b78464e10a0fb011df133aaf1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c46ebe5d6a74509ba46325e2376d170', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127552) authorize /opt/stack/nova/nova/policy.py:199}} Sep 03 01:48:02.514585 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-dd59a1a4-f51e-4495-ac24-7d7fa440898c tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 200 len: 1225 microversion: 2.1 time: 0.153205 Sep 03 01:48:02.515328 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 667/1306] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:48:02 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 1225 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 03 01:48:03.538987 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ecaf2a20-1e1e-4866-b979-d037a49dea46 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '>' {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:48:03.539595 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.compute.api [None req-ecaf2a20-1e1e-4866-b979-d037a49dea46 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] [instance: fce8f86d-7223-40db-9d53-68e5b4a309cd] Fetching instance by UUID {{(pid=127553) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 03 01:48:03.546668 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecaf2a20-1e1e-4866-b979-d037a49dea46 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:48:03.547151 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecaf2a20-1e1e-4866-b979-d037a49dea46 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:48:03.547590 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecaf2a20-1e1e-4866-b979-d037a49dea46 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:48:03.548276 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecaf2a20-1e1e-4866-b979-d037a49dea46 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Acquiring lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 03 01:48:03.548728 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecaf2a20-1e1e-4866-b979-d037a49dea46 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 03 01:48:03.549148 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG oslo_concurrency.lockutils [None req-ecaf2a20-1e1e-4866-b979-d037a49dea46 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Lock "6a8cb256-d368-4056-95f0-fbb32024e9fd" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127553) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 03 01:48:03.562810 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.wsgi [None req-ecaf2a20-1e1e-4866-b979-d037a49dea46 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] HTTP exception thrown: Instance fce8f86d-7223-40db-9d53-68e5b4a309cd could not be found. Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ecaf2a20-1e1e-4866-b979-d037a49dea46 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Request method failure captured: Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: request: GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd HTTP/1.1 Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept: application/json Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Accept-Encoding: identity Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Connection: close Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Length: 0 Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Content-Type: application/json Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Host: 10.222.0.13 Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: Openstack-System-Scope: None Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: User-Agent: python-urllib3/1.26.12 Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Auth-Token: gAAAAABjErE-1Cnk1vw4OZ1CG27IAz2BEenC5uP0DDdF5xDpWqjrM-h3-PV1IegKn14GIJhwPUlzvKsWlWESCIFVSDdnJzWVQpCpFoptwkrEPhtR12H5KwnwGgag9ho6cIR4Z50A7SqNaxhIt2iuIpHIboGV2cj6lDhvnu_cytiXtjHJDrSwhCU Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Id: None Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Domain-Name: None Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Identity-Status: Confirmed Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Is-Admin-Project: True Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Id: default Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Domain-Name: Default Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Id: 4c46ebe5d6a74509ba46325e2376d170 Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Project-Name: tempest-TestShelveInstance-964521066 Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Role: member,reader Sep 03 01:48:03.564436 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Roles: member,reader Sep 03 01:48:03.566237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4c46ebe5d6a74509ba46325e2376d170"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4c46ebe5d6a74509ba46325e2376d170"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c46ebe5d6a74509ba46325e2376d170"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4c46ebe5d6a74509ba46325e2376d170"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Sep 03 01:48:03.566237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant: tempest-TestShelveInstance-964521066 Sep 03 01:48:03.566237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Id: 4c46ebe5d6a74509ba46325e2376d170 Sep 03 01:48:03.566237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-Tenant-Name: tempest-TestShelveInstance-964521066 Sep 03 01:48:03.566237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User: tempest-TestShelveInstance-964521066-project Sep 03 01:48:03.566237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Id: default Sep 03 01:48:03.566237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Domain-Name: Default Sep 03 01:48:03.566237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Id: 7ebb858b78464e10a0fb011df133aaf1 Sep 03 01:48:03.566237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: X-User-Name: tempest-TestShelveInstance-964521066-project Sep 03 01:48:03.566237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: method: > Sep 03 01:48:03.566237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: exception: Instance fce8f86d-7223-40db-9d53-68e5b4a309cd could not be found. Sep 03 01:48:03.566237 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: action_args: {'id': 'fce8f86d-7223-40db-9d53-68e5b4a309cd'} Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: {{(pid=127553) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fce8f86d-7223-40db-9d53-68e5b4a309cd could not be found. Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 03 01:48:03.567335 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fce8f86d-7223-40db-9d53-68e5b4a309cd could not be found. Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fce8f86d-7223-40db-9d53-68e5b4a309cd could not be found. Sep 03 01:48:03.569056 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: ERROR nova.api.openstack.wsgi Sep 03 01:48:03.570653 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: DEBUG nova.api.openstack.wsgi [None req-ecaf2a20-1e1e-4866-b979-d037a49dea46 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Returning 404 to user: Instance fce8f86d-7223-40db-9d53-68e5b4a309cd could not be found. {{(pid=127553) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 03 01:48:03.570653 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: INFO nova.api.openstack.requestlog [None req-ecaf2a20-1e1e-4866-b979-d037a49dea46 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd" status: 404 len: 111 microversion: 2.1 time: 0.031053 Sep 03 01:48:03.570653 dv-cinder-838009-7-iscsi devstack@n-api.service[127553]: [pid: 127553|app: 0|req: 640/1307] 10.222.0.13 () {58 vars in 1236 bytes} [Sat Sep 3 01:48:03 2022] GET /compute/v2.1/servers/fce8f86d-7223-40db-9d53-68e5b4a309cd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 03 01:48:03.804759 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: DEBUG nova.api.openstack.wsgi [None req-4e5918bb-4ce6-496a-9a4c-8ac79fe1b109 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] Calling method '.version_select at 0x7f6d2819c430>' {{(pid=127552) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 03 01:48:03.908416 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: INFO nova.api.openstack.requestlog [None req-4e5918bb-4ce6-496a-9a4c-8ac79fe1b109 tempest-TestShelveInstance-964521066 tempest-TestShelveInstance-964521066-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1569621273" status: 202 len: 0 microversion: 2.1 time: 0.107645 Sep 03 01:48:03.909005 dv-cinder-838009-7-iscsi devstack@n-api.service[127552]: [pid: 127552|app: 0|req: 668/1308] 10.222.0.13 () {58 vars in 1254 bytes} [Sat Sep 3 01:48:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1569621273 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)